Jul 07 10:26:52 devstack cinder-volume[75979]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 10:26:52 devstack cinder-volume[75979]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 10:26:52 devstack cinder-volume[75979]: we strongly recommend against using it for new projects. Jul 07 10:26:52 devstack cinder-volume[75979]: If you are already using Eventlet, we recommend migrating to a different Jul 07 10:26:52 devstack cinder-volume[75979]: framework. For more detail see Jul 07 10:26:52 devstack cinder-volume[75979]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 10:26:52 devstack cinder-volume[75979]: import eventlet # noqa Jul 07 10:26:55 devstack cinder-volume[75979]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 10:26:55 devstack cinder-volume[75979]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 10:26:55 devstack cinder-volume[75979]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 10:26:55 devstack cinder-volume[75979]: INFO dbcounter [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Registered counter for database cinder Jul 07 10:26:56 devstack cinder-volume[75979]: DEBUG oslo_db.sqlalchemy.engines [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:26:56 devstack cinder-volume[75979]: DEBUG dbcounter [-] [75979] Writer thread running {{(pid=75979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 10:26:56 devstack cinder-volume[75979]: INFO cinder.rpc [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 10:26:56 devstack cinder-volume[75979]: INFO cinder.rpc [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 10:26:56 devstack cinder-volume[75979]: DEBUG oslo_db.sqlalchemy.engines [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:26:56 devstack cinder-volume[75979]: INFO cinder.volume.manager [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Determined volume DB was empty at startup. Jul 07 10:26:56 devstack cinder-volume[75979]: DEBUG cinder.volume.manager [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75979) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 10:26:56 devstack cinder-volume[75979]: INFO cinder.volume.manager [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 10:26:56 devstack cinder-volume[75979]: WARNING stevedore.named [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 10:26:56 devstack cinder-volume[75979]: WARNING castellan.key_manager [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 10:26:56 devstack cinder-volume[75979]: WARNING cinder.keymgr.conf_key_mgr [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 10:26:56 devstack cinder-volume[75979]: DEBUG cinder.volume.drivers.lvm [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75979) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 10:26:56 devstack cinder-volume[75979]: DEBUG oslo_concurrency.processutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_concurrency.processutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.381s {{(pid=75979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_db.sqlalchemy.engines [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:26:57 devstack cinder-volume[75979]: INFO cinder.rpc [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 10:26:57 devstack cinder-volume[75979]: INFO cinder.rpc [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 10:26:57 devstack cinder-volume[75979]: WARNING stevedore.named [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 10:26:57 devstack cinder-volume[75979]: WARNING castellan.key_manager [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 10:26:57 devstack cinder-volume[75979]: INFO cinder.volume.manager [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_db.sqlalchemy.engines [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:26:57 devstack cinder-volume[75979]: INFO oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Starting 1 workers Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Started child 76139 {{(pid=75979) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Full set of CONF: {{(pid=75979) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] ******************************************************************************** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Configuration options gathered from: {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] ================================================================================ {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] allow_availability_zone_fallback = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] allow_compression_on_image_upload = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] allowed_direct_url_schemes = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] api_rate_limit = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] auth_strategy = keystone {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] az_cache_duration = 3600 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_availability_zone = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_host = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[76139]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_stats_polling_interval = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backup_api_class = cinder.backup.api.API {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backup_name_template = backup-%s {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backup_use_same_host = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backup_use_temp_snapshot = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] chap_password = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] chap_username = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_internal_tenant_project_id = dd640032a5a74e0db4211122e29650dc {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_internal_tenant_user_id = a30675eb8038486a884cb7ea829d27ff {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cloned_volume_same_az = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cluster = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] compression_format = gzip {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] compute_api_class = cinder.compute.nova.API {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] config_dir = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] config_source = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] control_exchange = openstack {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] debug = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] default_availability_zone = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] default_group_type = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] default_volume_type = lvmdriver-1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] disk_geometry = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] driver_client_cert = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] driver_client_cert_key = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] driver_data_namespace = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] driver_ssl_cert_path = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] driver_ssl_cert_verify = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] driver_use_ssl = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] enable_force_upload = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] enable_new_services = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] enable_unsupported_driver = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] enforce_multipath_for_image_xfer = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] filter_function = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_api_insecure = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_api_servers = ['http://192.168.122.158/image'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_api_ssl_compression = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_ca_certificates_file = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_catalog_info = image:glance:publicURL {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_num_retries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance_request_timeout = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] goodness_function = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] graceful_shutdown_timeout = 5 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] group_api_class = cinder.group.api.API {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] host = devstack {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_compress_on_upload = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_conversion_address_space_limit = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_conversion_cpu_limit = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_conversion_disable = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_upload_use_cinder_backend = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_upload_use_internal_tenant = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_volume_cache_enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_volume_cache_max_count = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] image_volume_cache_max_size_gb = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] init_host_max_objects_retrieval = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] instance_format = [instance: %(uuid)s] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] iscsi_target_flags = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] iscsi_write_cache = on {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] iser_helper = tgtadm {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] iser_ip_address = 192.168.122.158 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] iser_port = 3260 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_color = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_config_append = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_dir = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_file = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_options = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_rotate_interval = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_rotate_interval_type = days {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] log_rotation_type = none {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] max_age = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] max_logfile_count = 30 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] max_logfile_size_mb = 200 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] max_over_subscription_ratio = 20.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] message_reap_interval = 86400 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] message_ttl = 2592000 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] migration_create_volume_timeout_secs = 300 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] monkey_patch = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] monkey_patch_modules = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] my_ip = 192.168.122.158 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] no_snapshot_gb_quota = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] num_iser_scan_tries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] num_shell_tries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] num_volume_device_scan_tries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] nvmeof_conn_info_version = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] nvmet_ns_id = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] nvmet_port_id = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] osapi_max_limit = 1000 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] osapi_volume_ext_list = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] osapi_volume_listen_port = 8776 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] osapi_volume_use_ssl = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] osapi_volume_workers = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] per_volume_size_limit = -1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] periodic_fuzzy_delay = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] periodic_interval = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] public_endpoint = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] publish_errors = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] quota_backup_gigabytes = 1000 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] quota_backups = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] quota_gigabytes = 1000 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] quota_groups = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] quota_snapshots = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] quota_volumes = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] rate_limit_burst = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] rate_limit_except_level = CRITICAL {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] rate_limit_interval = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] reinit_driver_count = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] replication_device = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] report_discard_supported = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] report_interval = 120 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] reservation_clean_interval = 86400 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] reservation_expire = 86400 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] reserved_image_namespaces = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] reserved_percentage = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] rpc_response_timeout = 120 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] run_external_periodic_tasks = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] scst_target_driver = iscsi {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] scst_target_iqn_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_down_time = 720 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] shell_completion = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] snapshot_name_template = snapshot-%s {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] snapshot_same_host = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] split_loggers = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] state_path = /opt/stack/data/cinder {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] storage_availability_zone = nova {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] storage_protocol = iSCSI {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] syslog_log_facility = LOG_USER {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] target_helper = lioadm {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] target_ip_address = 192.168.122.158 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] target_port = 3260 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] target_protocol = iscsi {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] target_secondary_ip_addresses = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] trace_flags = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] transport_url = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] until_refresh = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] use_chap_auth = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] use_default_quota_class = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] use_journal = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] use_json = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] use_multipath_for_image_xfer = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] use_stderr = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] use_syslog = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] verify_glance_signatures = enabled {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_api_class = cinder.volume.api.API {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_backend_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_clear = zero {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_clear_ionice = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_clear_size = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_copy_bps_limit = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_dd_blocksize = 1M {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_name_template = volume-%s {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_service_inithost_offload = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volume_usage_audit_period = month {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] zoning_mode = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.auth_section = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.auth_type = password {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.auth_version = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.cache = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.include_service_catalog = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.insecure = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.interface = public {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_password = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcache_username = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 10:26:57 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.region_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.service_type = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.backend = dogpile.cache.null {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.backend_argument = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.backend_expiration_time = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.config_prefix = cache.oslo {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.debug_cache_backend = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.enable_retry_client = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.enable_socket_keepalive = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.expiration_time = 600 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.memcache_dead_retry = 300 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.memcache_pool_maxsize = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.memcache_sasl_enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.password = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.proxies = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.redis_db = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.redis_server = localhost:6379 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.retry_attempts = 2 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.retry_delay = 0.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.socket_keepalive_count = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.socket_keepalive_idle = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.socket_keepalive_interval = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.socket_timeout = 1.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.tls_allowed_ciphers = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.tls_cafile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.tls_certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.tls_enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.tls_keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cache.username = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] coordination.backend_url = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.asyncio_connection = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.asyncio_slave_connection = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.backend = sqlalchemy {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.connection = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.connection_debug = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.connection_parameters = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.connection_recycle_time = 3600 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.connection_trace = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.db_inc_retry_interval = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.db_max_retries = 20 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.db_max_retry_interval = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.db_retry_interval = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.max_overflow = 50 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.max_pool_size = 5 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.max_retries = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.pool_timeout = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.retry_interval = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.slave_connection = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.sqlite_synchronous = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.synchronous_reader = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] database.use_db_reconnect = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.connection_string = messaging:// {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.es_doc_type = notification {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.es_scroll_size = 10000 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.es_scroll_time = 2m {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.filter_error_trace = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.hmac_keys = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.sentinel_service_name = mymaster {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.socket_timeout = 0.1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.trace_requests = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler.trace_sqlalchemy = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler_jaeger.process_tags = {} {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] profiler_otlp.service_name_prefix = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.enforce_scope = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.policy_default_rule = default {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.policy_file = policy.yaml {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] privsep_osbrick.group = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] privsep_osbrick.helper_command = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] privsep_osbrick.user = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_sys_admin.group = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_sys_admin.helper_command = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] cinder_sys_admin.user = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.auth_section = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.auth_type = password {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.cafile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.collect_timing = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.insecure = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.send_service_user_token = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.split_loggers = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] service_user.timeout = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.auth_section = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.auth_type = password {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.collect_timing = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.insecure = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.region_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.split_loggers = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] glance.timeout = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.backend_availability_zone = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.chap_password = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.chap_username = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.disk_geometry = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.driver_client_cert = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.driver_client_cert_key = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.driver_data_namespace = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.driver_use_ssl = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.extra_capabilities = {} {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.filter_function = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.goodness_function = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.iscsi_target_flags = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.iscsi_write_cache = on {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.iser_helper = tgtadm {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.iser_port = 3260 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.lvm_share_target = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.lvm_type = auto {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.num_shell_tries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.replication_device = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.report_discard_supported = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.reserved_percentage = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.target_helper = tgtadm {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.target_port = 3260 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.target_protocol = iscsi {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.trace_flags = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.unique_fqdn_network = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.use_chap_auth = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_backend_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_clear = zero {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_clear_ionice = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_clear_size = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_reports.file_event_handler = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_reports.log_dir = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.backend_host = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.chap_password = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.chap_username = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.disk_geometry = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.driver_client_cert = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.extra_capabilities = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.filter_function = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.goodness_function = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.iser_helper = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.iser_ip_address = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.iser_port = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.lvm_share_target = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.lvm_type = auto {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.num_shell_tries = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.replication_device = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.report_discard_supported = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.reserved_percentage = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.scst_target_driver = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.storage_protocol = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.target_helper = lioadm {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.target_ip_address = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.target_port = 3260 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.trace_flags = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.use_chap_auth = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_clear = zero {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_clear_size = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] lvmdriver-1.volumes_dir = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.ssl = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_notifications.driver = [] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] key_manager.fixed_key = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.barbican_api_version = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.barbican_endpoint = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.barbican_endpoint_type = public {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.barbican_region_name = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.cafile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.collect_timing = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.insecure = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.number_of_retries = 60 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.retry_delay = 1 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.send_service_user_token = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.split_loggers = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.timeout = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.verify_ssl = True {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican.verify_ssl_path = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.auth_section = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.auth_type = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.cafile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.certfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.collect_timing = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.insecure = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.keyfile = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.split_loggers = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] barbican_service_user.timeout = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.approle_role_id = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.approle_secret_id = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.kv_mountpoint = secret {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.kv_path = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.kv_version = 2 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.namespace = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.root_token_id = **** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.ssl_ca_crt_file = None {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.timeout = 60.0 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.use_ssl = False {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:26:57 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] ******************************************************************************** {{(pid=75979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 10:26:58 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Jul 07 10:26:58 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:58 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:58 devstack sudo[76310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:26:58 devstack sudo[76310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:26:58 devstack sudo[76310]: pam_unix(sudo:session): session closed for user root Jul 07 10:26:58 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.654s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:58 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:26:58 devstack cinder-volume[76139]: INFO cinder.brick.local_dev.lvm [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 10:26:58 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:58 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:58 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:58 devstack sudo[76522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:26:58 devstack sudo[76522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:26:59 devstack sudo[76522]: pam_unix(sudo:session): session closed for user root Jul 07 10:26:59 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:26:59 devstack cinder-volume[76139]: DEBUG cinder.brick.local_dev.lvm [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76139) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 10:26:59 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:26:59 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:26:59 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:00 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:00 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.042s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:00 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:00 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:00 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:00 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:27:00 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:01 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.693s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:01 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 10:27:01 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:01 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.682s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:02 devstack sudo[76926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:27:02 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:02 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:02 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.955s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:02 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:02 devstack sudo[76931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:27:02 devstack sudo[76931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:03 devstack sudo[76931]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:03 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.792s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:03 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:03 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:27:03 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:04 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:04 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.748s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:04 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:04 devstack sudo[76949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:27:04 devstack sudo[76949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:05 devstack sudo[76949]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:05 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:27:05 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:05 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:05 devstack cinder-volume[76139]: INFO cinder.volume.drivers.lvm [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:05 devstack sudo[76966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:27:05 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:06 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:06 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:06 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 10:27:06 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:06 devstack sudo[77079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:27:06 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:07 devstack cinder-volume[75979]: DEBUG dbcounter [-] [75979] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:27:07 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:07 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:07 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:07 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:27:07 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:07 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:07 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:07 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:07 devstack sudo[77227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:27:07 devstack sudo[77227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:08 devstack sudo[77227]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:08 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:08 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:08 devstack sudo[77230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:27:08 devstack sudo[77230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:09 devstack sudo[77230]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:09 devstack cinder-volume[76139]: INFO cinder.volume.driver [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Driver hasn't implemented _init_vendor_properties() Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG cinder.volume.driver [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76139) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG oslo_db.sqlalchemy.engines [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writer thread running {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG cinder.db.api [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Building query based on filter {{(pid=76139) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG cinder.image.image_utils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76139) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 10:27:09 devstack cinder-volume[76139]: INFO cinder.keymgr.migration [None req-881f12e0-3323-41de-ba69-836a380697dd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:09 devstack sudo[77235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:27:09 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:09 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:09 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:09 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:27:09 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:10 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:10 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:10 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:10 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:27:10 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:11 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:11 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:11 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:11 devstack sudo[77249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:27:11 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:11 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:11 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:11 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:27:11 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Driver initialization completed successfully. Jul 07 10:27:11 devstack cinder-volume[76139]: INFO cinder.manager [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Initiating service 2 cleanup Jul 07 10:27:11 devstack cinder-volume[76139]: INFO cinder.manager [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Service 2 cleanup completed. Jul 07 10:27:11 devstack cinder-volume[76139]: DEBUG cinder.service [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Creating RPC server for service cinder-volume {{(pid=76139) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 10:27:11 devstack cinder-volume[76139]: DEBUG cinder.service [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76139) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 10:27:12 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 10:27:12 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 10:27:12 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:12 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:27:12 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:12 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:12 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:12 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:12 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:27:12 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:13 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:13 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:13 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:13 devstack sudo[77266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:27:13 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:14 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:14 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:14 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:27:14 devstack sudo[77272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:27:14 devstack sudo[77272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:27:14 devstack sudo[77272]: pam_unix(sudo:session): session closed for user root Jul 07 10:27:14 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:27:14 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-36b5f6c3-49ff-4a8f-8374-7e4a539a888b None None] Driver post RPC initialization completed successfully. Jul 07 10:27:24 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=2 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:27:24 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:27:41 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running periodic task VolumeManager._thread_info {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:27:41 devstack cinder-volume[76139]: DEBUG cinder.volume.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] thread count: 6 {{(pid=76139) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:27:41 devstack cinder-volume[76139]: DEBUG cinder.volume.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] thread info: [<_MainThread(MainThread, started 135879544471680)>, , , , , ] {{(pid=76139) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:28:41 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:28:41 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 10:28:41 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:28:41 devstack sudo[79649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:28:41 devstack sudo[79649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:28:42 devstack sudo[79649]: pam_unix(sudo:session): session closed for user root Jul 07 10:28:42 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:28:42 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:28:42 devstack sudo[79653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:28:42 devstack sudo[79653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:28:43 devstack sudo[79653]: pam_unix(sudo:session): session closed for user root Jul 07 10:28:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:28:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:28:43 devstack sudo[79658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:28:43 devstack sudo[79658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:28:43 devstack sudo[79658]: pam_unix(sudo:session): session closed for user root Jul 07 10:28:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:28:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:28:43 devstack sudo[80012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:28:43 devstack sudo[80012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:28:44 devstack sudo[80012]: pam_unix(sudo:session): session closed for user root Jul 07 10:28:44 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:28:44 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:28:44 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running periodic task VolumeManager._thread_info {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:28:44 devstack cinder-volume[76139]: DEBUG cinder.volume.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] thread count: 6 {{(pid=76139) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:28:44 devstack cinder-volume[76139]: DEBUG cinder.volume.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] thread info: [<_MainThread(MainThread, started 135879544471680)>, , , , , ] {{(pid=76139) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:29:24 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:29:24 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:UPDATE=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:29:41 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:29:41 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 10:29:41 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:29:41 devstack sudo[83361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:29:41 devstack sudo[83361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:29:42 devstack sudo[83361]: pam_unix(sudo:session): session closed for user root Jul 07 10:29:42 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:29:42 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:29:42 devstack sudo[83386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:29:42 devstack sudo[83386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:29:43 devstack sudo[83386]: pam_unix(sudo:session): session closed for user root Jul 07 10:29:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:29:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:29:43 devstack sudo[83401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:29:43 devstack sudo[83401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:29:43 devstack sudo[83401]: pam_unix(sudo:session): session closed for user root Jul 07 10:29:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:29:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:29:43 devstack sudo[83467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:29:43 devstack sudo[83467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:29:44 devstack sudo[83467]: pam_unix(sudo:session): session closed for user root Jul 07 10:29:44 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:29:44 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:29:44 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running periodic task VolumeManager._thread_info {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:29:44 devstack cinder-volume[76139]: DEBUG cinder.volume.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] thread count: 6 {{(pid=76139) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:29:44 devstack cinder-volume[76139]: DEBUG cinder.volume.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] thread info: [<_MainThread(MainThread, started 135879544471680)>, , , , , ] {{(pid=76139) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:30:41 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:30:41 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 10:30:41 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:30:41 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 10:30:41 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:30:42 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Jul 07 10:30:42 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:30:42 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:30:42 devstack sudo[85062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:30:42 devstack sudo[85062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:30:43 devstack sudo[85062]: pam_unix(sudo:session): session closed for user root Jul 07 10:30:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:30:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:30:43 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 10:30:43 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:30:43 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Jul 07 10:30:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:30:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:30:43 devstack sudo[85101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 10:30:43 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:30:44 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root Jul 07 10:30:44 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:30:44 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-5be19154-5ecb-4a27-bba9-a27a64142912 None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:31:24 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:31:24 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:UPDATE=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:31:32 devstack cinder-volume[75979]: INFO oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Caught SIGTERM, stopping children Jul 07 10:31:32 devstack cinder-volume[75979]: DEBUG oslo_concurrency.lockutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Acquiring lock "singleton_lock" {{(pid=75979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 10:31:32 devstack cinder-volume[75979]: DEBUG oslo_concurrency.lockutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Acquired lock "singleton_lock" {{(pid=75979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 10:31:32 devstack cinder-volume[75979]: DEBUG oslo_concurrency.lockutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Releasing lock "singleton_lock" {{(pid=75979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 10:31:32 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Stop services. {{(pid=75979) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 10:31:32 devstack cinder-volume[75979]: DEBUG oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Killing children. {{(pid=75979) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 10:31:32 devstack cinder-volume[75979]: INFO oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Waiting on 1 children to exit Jul 07 10:31:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Acquiring lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 10:31:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Acquired lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 10:31:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Releasing lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 10:31:37 devstack cinder-volume[76139]: WARNING amqp [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 10:31:37 devstack cinder-volume[76139]: WARNING amqp [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 10:31:37 devstack cinder-volume[75979]: INFO oslo_service.backend._eventlet.service [None req-efee1e78-3d2d-4a8e-8191-5c3a2b2c73c4 None None] Child 76139 exited with status 0 Jul 07 10:31:37 devstack cinder-volume[86223]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 10:31:37 devstack cinder-volume[86223]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 10:31:37 devstack cinder-volume[86223]: we strongly recommend against using it for new projects. Jul 07 10:31:37 devstack cinder-volume[86223]: If you are already using Eventlet, we recommend migrating to a different Jul 07 10:31:37 devstack cinder-volume[86223]: framework. For more detail see Jul 07 10:31:37 devstack cinder-volume[86223]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 10:31:37 devstack cinder-volume[86223]: import eventlet # noqa Jul 07 10:31:39 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 10:31:39 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 10:31:39 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 10:31:40 devstack cinder-volume[86223]: INFO dbcounter [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Registered counter for database cinder Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG dbcounter [-] [86223] Writer thread running {{(pid=86223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 10:31:40 devstack cinder-volume[86223]: INFO cinder.rpc [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 10:31:40 devstack cinder-volume[86223]: INFO cinder.rpc [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:40 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Determined volume DB was empty at startup. Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG cinder.volume.manager [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86223) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 10:31:40 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 10:31:40 devstack cinder-volume[86223]: WARNING stevedore.named [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 10:31:40 devstack cinder-volume[86223]: WARNING castellan.key_manager [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 10:31:40 devstack cinder-volume[86223]: WARNING cinder.keymgr.conf_key_mgr [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 10:31:40 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:40 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Starting 1 workers Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Started child 86441 {{(pid=86223) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Full set of CONF: {{(pid=86223) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Configuration options gathered from: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] ================================================================================ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] allow_availability_zone_fallback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] allow_compression_on_image_upload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] allowed_direct_url_schemes = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] api_rate_limit = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] auth_strategy = keystone {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_stats_polling_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backup_api_class = cinder.backup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backup_name_template = backup-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backup_use_same_host = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86441]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_internal_tenant_project_id = dd640032a5a74e0db4211122e29650dc {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_internal_tenant_user_id = a30675eb8038486a884cb7ea829d27ff {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cluster = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] compression_format = gzip {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] compute_api_class = cinder.compute.nova.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] config_dir = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] config_source = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] control_exchange = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] debug = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] default_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] default_group_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] default_volume_type = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] enable_new_services = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] enabled_backends = ['QuobyteHD'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_api_insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_api_servers = ['http://192.168.122.158/image'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_api_ssl_compression = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_ca_certificates_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_catalog_info = image:glance:publicURL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_num_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance_request_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] graceful_shutdown_timeout = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] group_api_class = cinder.group.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] host = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_compress_on_upload = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_conversion_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_conversion_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_conversion_disable = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] init_host_max_objects_retrieval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] instance_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] iser_ip_address = 192.168.122.158 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_color = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_config_append = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_options = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_rotate_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_rotate_interval_type = days {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] log_rotation_type = none {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] max_age = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] max_logfile_count = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] max_logfile_size_mb = 200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] message_reap_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] message_ttl = 2592000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] migration_create_volume_timeout_secs = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] monkey_patch = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] monkey_patch_modules = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] my_ip = 192.168.122.158 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] no_snapshot_gb_quota = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] osapi_max_limit = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] osapi_volume_ext_list = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] osapi_volume_listen_port = 8776 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] osapi_volume_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] osapi_volume_workers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] per_volume_size_limit = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] periodic_fuzzy_delay = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] periodic_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] public_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] publish_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] quota_backup_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] quota_backups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] quota_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] quota_groups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] quota_snapshots = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] quota_volumes = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] rate_limit_burst = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] rate_limit_except_level = CRITICAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] rate_limit_interval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] reinit_driver_count = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] report_interval = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] reservation_clean_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] reservation_expire = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] reserved_image_namespaces = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] rpc_response_timeout = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] run_external_periodic_tasks = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_down_time = 720 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] shell_completion = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] snapshot_name_template = snapshot-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] state_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] storage_availability_zone = nova {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] syslog_log_facility = LOG_USER {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] target_helper = lioadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] target_ip_address = 192.168.122.158 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] until_refresh = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] use_default_quota_class = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] use_journal = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] use_json = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] use_stderr = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] use_syslog = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] verify_glance_signatures = enabled {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_api_class = cinder.volume.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.remotefs [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86441) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_name_template = volume-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_service_inithost_offload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volume_usage_audit_period = month {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] zoning_mode = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_concurrency.disable_process_locking = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.auth_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.include_service_catalog = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.interface = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_password = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcache_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.service_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.backend = dogpile.cache.null {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.backend_argument = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.backend_expiration_time = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.config_prefix = cache.oslo {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.debug_cache_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.enable_retry_client = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.enable_socket_keepalive = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.expiration_time = 600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.hashclient_retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.memcache_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.proxies = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.redis_db = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.redis_server = localhost:6379 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.retry_delay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.socket_keepalive_count = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.socket_keepalive_idle = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.socket_keepalive_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.socket_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cache.username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] coordination.backend_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.asyncio_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.asyncio_slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.backend = sqlalchemy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.connection_debug = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.connection_parameters = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.connection_recycle_time = 3600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.connection_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.db_inc_retry_interval = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.db_max_retries = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.db_max_retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.db_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.max_overflow = 50 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.max_pool_size = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.max_retries = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.mysql_wsrep_sync_wait = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.pool_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.sqlite_synchronous = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.synchronous_reader = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] database.use_db_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.connection_string = messaging:// {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.es_doc_type = notification {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.es_scroll_size = 10000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.es_scroll_time = 2m {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.filter_error_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.hmac_keys = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.socket_timeout = 0.1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.trace_requests = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler.trace_sqlalchemy = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler_jaeger.process_tags = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler_jaeger.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] profiler_otlp.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.enforce_new_defaults = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.enforce_scope = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.policy_default_rule = default {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.policy_file = policy.yaml {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] privsep_osbrick.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] privsep_osbrick.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] privsep_osbrick.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_sys_admin.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_sys_admin.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] cinder_sys_admin.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.send_service_user_token = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] glance.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.extra_capabilities = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_host = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_login = admin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_private_key = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_share_path = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.quobyte_volume_url = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.target_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.unique_fqdn_network = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_reports.file_event_handler = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_reports.log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.chap_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.chiscsi_conf = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86441) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 10:31:41 devstack cinder-volume[86441]: WARNING cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 10:31:41 devstack cinder-volume[86441]: WARNING cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.driver_use_ssl = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.extra_capabilities = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Running cmd (subprocess): mount.quobyte {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.iser_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.iser_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.iser_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.iser_target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_login = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_private_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_share_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_ssh_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.num_shell_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.nvmet_port_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.report_discard_supported = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.reserved_percentage = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.scst_target_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.storage_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.target_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.target_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.target_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.target_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.use_chap_auth = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_clear = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_clear_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] QuobyteHD.volumes_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_notifications.driver = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_notifications.retry = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] key_manager.fixed_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.barbican_api_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.barbican_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.barbican_endpoint_type = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.barbican_region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.number_of_retries = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.retry_delay = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.send_service_user_token = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.verify_ssl = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican.verify_ssl_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.auth_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] barbican_service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.approle_role_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.approle_secret_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.kv_mountpoint = secret {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.kv_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.kv_version = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.root_token_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:41 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 10:31:41 devstack quobyte-client[86442]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 10:31:41 devstack quobyte-client[86442]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:31:41 devstack cinder-volume[86441]: INFO cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 ... Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 -c /etc/quobyte/client-cinder.cfg {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:41 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 -c /etc/quobyte/client-cinder.cfg Jul 07 10:31:41 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:31:41 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.769s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:41 devstack cinder-volume[86441]: INFO cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 succeeded Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.783s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:31:41 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:41 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:31:41 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:31:42 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.654s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:42 devstack cinder-volume[86441]: INFO cinder.volume.driver [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Driver hasn't implemented _init_vendor_properties() Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG cinder.volume.driver [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86441) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG oslo_db.sqlalchemy.engines [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG dbcounter [-] [86441] Writer thread running {{(pid=86441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG cinder.db.api [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Building query based on filter {{(pid=86441) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG cinder.image.image_utils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86441) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 10:31:42 devstack cinder-volume[86441]: INFO cinder.keymgr.migration [None req-22ab5843-2f51-4df8-9e32-55b164f7ad67 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:31:42 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:42 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:31:42 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:31:43 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.674s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG cinder.manager [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Notifying Schedulers of capabilities ... {{(pid=86441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:31:43 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Driver initialization completed successfully. Jul 07 10:31:43 devstack cinder-volume[86441]: INFO cinder.manager [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Initiating service 3 cleanup Jul 07 10:31:43 devstack cinder-volume[86441]: INFO cinder.manager [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Service 3 cleanup completed. Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG cinder.service [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Creating RPC server for service cinder-volume {{(pid=86441) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG cinder.service [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86441) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 10:31:43 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:31:43 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:43 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:31:43 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:31:44 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Jul 07 10:31:44 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.831s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:44 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-4abdacd4-e2d1-4e9e-9397-ba50b58ed20c None None] Driver post RPC initialization completed successfully. Jul 07 10:31:48 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:31:48 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:31:48 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:31:48 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:31:48 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:31:48 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:48 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:31:48 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:31:49 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Jul 07 10:31:49 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.633s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:49 devstack cinder-volume[86441]: DEBUG cinder.manager [None req-86827e6a-80b6-4b77-8e6d-1bd59177ddb6 None None] Notifying Schedulers of capabilities ... {{(pid=86441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:31:50 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Caught SIGTERM, stopping children Jul 07 10:31:50 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 10:31:50 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 10:31:50 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 10:31:50 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Stop services. {{(pid=86223) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 10:31:50 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Killing children. {{(pid=86223) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 10:31:50 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Waiting on 1 children to exit Jul 07 10:31:51 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Acquiring lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 10:31:51 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Acquired lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 10:31:51 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Releasing lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 10:31:51 devstack cinder-volume[86441]: WARNING amqp [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 10:31:51 devstack cinder-volume[86441]: WARNING amqp [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 10:31:51 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-0e4b7fa0-e17a-4ead-adaa-d5eef08a682e None None] Child 86441 exited with status 0 Jul 07 10:31:52 devstack cinder-volume[86909]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 10:31:52 devstack cinder-volume[86909]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 10:31:52 devstack cinder-volume[86909]: we strongly recommend against using it for new projects. Jul 07 10:31:52 devstack cinder-volume[86909]: If you are already using Eventlet, we recommend migrating to a different Jul 07 10:31:52 devstack cinder-volume[86909]: framework. For more detail see Jul 07 10:31:52 devstack cinder-volume[86909]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 10:31:52 devstack cinder-volume[86909]: import eventlet # noqa Jul 07 10:31:55 devstack cinder-volume[86909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86909) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 10:31:55 devstack cinder-volume[86909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86909) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 10:31:55 devstack cinder-volume[86909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86909) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 10:31:56 devstack cinder-volume[86909]: INFO dbcounter [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Registered counter for database cinder Jul 07 10:31:56 devstack cinder-volume[86909]: DEBUG oslo_db.sqlalchemy.engines [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86909) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG dbcounter [-] [86909] Writer thread running {{(pid=86909) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 10:31:57 devstack cinder-volume[86909]: INFO cinder.rpc [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 10:31:57 devstack cinder-volume[86909]: INFO cinder.rpc [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_db.sqlalchemy.engines [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86909) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:57 devstack cinder-volume[86909]: INFO cinder.volume.manager [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Determined volume DB was empty at startup. Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG cinder.volume.manager [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86909) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 10:31:57 devstack cinder-volume[86909]: WARNING stevedore.named [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 10:31:57 devstack cinder-volume[86909]: WARNING castellan.key_manager [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 10:31:57 devstack cinder-volume[86909]: WARNING cinder.keymgr.conf_key_mgr [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 10:31:57 devstack cinder-volume[86909]: INFO cinder.volume.manager [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_db.sqlalchemy.engines [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86909) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:57 devstack cinder-volume[86909]: INFO oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Starting 1 workers Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Started child 87208 {{(pid=86909) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Full set of CONF: {{(pid=86909) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] ******************************************************************************** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] Configuration options gathered from: {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] ================================================================================ {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] allow_availability_zone_fallback = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] allow_compression_on_image_upload = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] allowed_direct_url_schemes = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] api_rate_limit = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] auth_strategy = keystone {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[87208]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_availability_zone = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_host = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_stats_polling_interval = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backup_api_class = cinder.backup.api.API {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backup_name_template = backup-%s {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backup_use_same_host = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backup_use_temp_snapshot = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] chap_password = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] chap_username = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_internal_tenant_project_id = dd640032a5a74e0db4211122e29650dc {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_internal_tenant_user_id = a30675eb8038486a884cb7ea829d27ff {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cluster = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] compression_format = gzip {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] compute_api_class = cinder.compute.nova.API {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] config_dir = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] config_source = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] control_exchange = openstack {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] debug = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] default_availability_zone = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] default_group_type = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] default_volume_type = QuobyteHD {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] disk_geometry = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] driver_client_cert = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] driver_client_cert_key = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] driver_data_namespace = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] driver_ssl_cert_path = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] driver_ssl_cert_verify = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] driver_use_ssl = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] enable_new_services = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] enable_unsupported_driver = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] enabled_backends = ['QuobyteHD'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] enforce_multipath_for_image_xfer = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] filter_function = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_api_insecure = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_api_servers = ['http://192.168.122.158/image'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_api_ssl_compression = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_ca_certificates_file = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_catalog_info = image:glance:publicURL {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_num_retries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance_request_timeout = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] goodness_function = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] graceful_shutdown_timeout = 5 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] group_api_class = cinder.group.api.API {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 10:31:57 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] host = devstack {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:57 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87208) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_compress_on_upload = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_conversion_address_space_limit = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_conversion_cpu_limit = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_conversion_disable = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_upload_use_cinder_backend = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_upload_use_internal_tenant = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_volume_cache_enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_volume_cache_max_count = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] image_volume_cache_max_size_gb = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] init_host_max_objects_retrieval = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] instance_format = [instance: %(uuid)s] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] iscsi_target_flags = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] iscsi_write_cache = on {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] iser_helper = tgtadm {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] iser_ip_address = 192.168.122.158 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] iser_port = 3260 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_color = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_config_append = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_dir = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_file = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_options = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_rotate_interval = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_rotate_interval_type = days {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] log_rotation_type = none {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] max_age = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] max_logfile_count = 30 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] max_logfile_size_mb = 200 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] max_over_subscription_ratio = 20.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] message_reap_interval = 86400 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] message_ttl = 2592000 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] migration_create_volume_timeout_secs = 300 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] monkey_patch = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] monkey_patch_modules = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] my_ip = 192.168.122.158 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] no_snapshot_gb_quota = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] num_iser_scan_tries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] num_shell_tries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] num_volume_device_scan_tries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] nvmeof_conn_info_version = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] nvmet_ns_id = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] nvmet_port_id = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] osapi_max_limit = 1000 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] osapi_volume_ext_list = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] osapi_volume_listen_port = 8776 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] osapi_volume_use_ssl = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] osapi_volume_workers = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] per_volume_size_limit = -1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] periodic_fuzzy_delay = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] periodic_interval = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] public_endpoint = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] publish_errors = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] quota_backup_gigabytes = 1000 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] quota_backups = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] quota_gigabytes = 1000 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] quota_groups = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] quota_snapshots = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] quota_volumes = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] rate_limit_burst = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] rate_limit_except_level = CRITICAL {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] rate_limit_interval = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] reinit_driver_count = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] replication_device = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] report_discard_supported = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] report_interval = 120 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] reservation_clean_interval = 86400 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] reservation_expire = 86400 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87208) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 10:31:58 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] reserved_image_namespaces = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] reserved_percentage = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] rpc_response_timeout = 120 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] run_external_periodic_tasks = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Running cmd (subprocess): mount.quobyte {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] scst_target_driver = iscsi {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] scst_target_iqn_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_down_time = 720 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] shell_completion = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] snapshot_name_template = snapshot-%s {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] split_loggers = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] state_path = /opt/stack/data/cinder {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] storage_availability_zone = nova {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] storage_protocol = iSCSI {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] syslog_log_facility = LOG_USER {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] target_helper = lioadm {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] target_ip_address = 192.168.122.158 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] target_port = 3260 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] target_protocol = iscsi {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] target_secondary_ip_addresses = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] trace_flags = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] transport_url = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] until_refresh = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] use_chap_auth = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] use_default_quota_class = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] use_journal = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] use_json = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] use_multipath_for_image_xfer = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] use_stderr = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] use_syslog = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] verify_glance_signatures = enabled {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_api_class = cinder.volume.api.API {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_backend_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_clear = zero {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_clear_ionice = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_clear_size = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_copy_bps_limit = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_dd_blocksize = 1M {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_name_template = volume-%s {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_service_inithost_offload = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volume_usage_audit_period = month {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] zoning_mode = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_concurrency.disable_process_locking = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.auth_section = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.auth_type = password {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.auth_version = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.cache = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.include_service_catalog = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.insecure = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.interface = public {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_password = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcache_username = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.region_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.service_type = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.backend = dogpile.cache.null {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.backend_argument = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.backend_expiration_time = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.config_prefix = cache.oslo {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.debug_cache_backend = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.enable_retry_client = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.enable_socket_keepalive = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.expiration_time = 600 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.hashclient_retry_attempts = 2 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.memcache_dead_retry = 300 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.memcache_pool_maxsize = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.memcache_sasl_enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.password = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.proxies = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.redis_db = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.redis_server = localhost:6379 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.retry_attempts = 2 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.retry_delay = 0.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.socket_keepalive_count = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.socket_keepalive_idle = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.socket_keepalive_interval = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.socket_timeout = 1.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.tls_allowed_ciphers = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.tls_cafile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.tls_certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.tls_enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.tls_keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cache.username = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] coordination.backend_url = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.asyncio_connection = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.asyncio_slave_connection = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.backend = sqlalchemy {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.connection = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.connection_debug = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.connection_parameters = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.connection_recycle_time = 3600 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.connection_trace = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.db_inc_retry_interval = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.db_max_retries = 20 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.db_max_retry_interval = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.db_retry_interval = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.max_overflow = 50 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.max_pool_size = 5 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.max_retries = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:31:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.mysql_wsrep_sync_wait = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.pool_timeout = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.retry_interval = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.slave_connection = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.sqlite_synchronous = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.synchronous_reader = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] database.use_db_reconnect = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.connection_string = messaging:// {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.es_doc_type = notification {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.es_scroll_size = 10000 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.es_scroll_time = 2m {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.filter_error_trace = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.hmac_keys = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.sentinel_service_name = mymaster {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.socket_timeout = 0.1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.trace_requests = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler.trace_sqlalchemy = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler_jaeger.process_tags = {} {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler_jaeger.service_name_prefix = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] profiler_otlp.service_name_prefix = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.enforce_new_defaults = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.enforce_scope = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.policy_default_rule = default {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.policy_file = policy.yaml {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] privsep_osbrick.group = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] privsep_osbrick.helper_command = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] privsep_osbrick.user = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_sys_admin.group = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_sys_admin.helper_command = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] cinder_sys_admin.user = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.auth_section = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.auth_type = password {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.cafile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.collect_timing = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.insecure = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.send_service_user_token = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.split_loggers = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] service_user.timeout = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.auth_section = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.auth_type = password {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.collect_timing = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.insecure = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.region_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.split_loggers = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] glance.timeout = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.backend_availability_zone = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.chap_password = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.chap_username = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.disk_geometry = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.driver_client_cert = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.driver_client_cert_key = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.driver_data_namespace = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.driver_use_ssl = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.extra_capabilities = {} {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.filter_function = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.goodness_function = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.iscsi_target_flags = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.iscsi_write_cache = on {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.iser_helper = tgtadm {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.iser_port = 3260 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_host = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_login = admin {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_mount_options = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_password = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_private_key = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_share_path = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.num_shell_tries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.quobyte_volume_url = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.replication_device = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.report_discard_supported = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.reserved_percentage = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.target_helper = tgtadm {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.target_port = 3260 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.target_protocol = iscsi {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.trace_flags = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.unique_fqdn_network = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.use_chap_auth = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_backend_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_clear = zero {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_clear_ionice = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_clear_size = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_reports.file_event_handler = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_reports.log_dir = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.backend_availability_zone = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.backend_host = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.chap_password = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.chap_username = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.chiscsi_conf = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.disk_geometry = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.driver_client_cert = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.driver_data_namespace = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.driver_use_ssl = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.extra_capabilities = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.filter_function = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.goodness_function = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.iser_helper = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.iser_ip_address = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.iser_port = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.iser_target_prefix = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_host = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_login = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_mount_options = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_password = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_private_key = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_share_path = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_ssh_port = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.num_shell_tries = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.nvmet_port_id = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.replication_device = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.report_discard_supported = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.reserved_percentage = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.scst_target_driver = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.storage_protocol = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.target_helper = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.target_ip_address = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.target_port = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.target_prefix = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.target_protocol = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.trace_flags = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.use_chap_auth = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_clear = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_clear_size = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] QuobyteHD.volumes_dir = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.ssl = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_notifications.driver = [] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_notifications.retry = -1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] key_manager.fixed_key = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.barbican_api_version = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.barbican_endpoint = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.barbican_endpoint_type = public {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.barbican_region_name = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.cafile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.collect_timing = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.insecure = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.number_of_retries = 60 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.retry_delay = 1 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.send_service_user_token = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.split_loggers = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.timeout = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.verify_ssl = True {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican.verify_ssl_path = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.auth_section = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.auth_type = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.cafile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.certfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.collect_timing = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.insecure = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.keyfile = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.split_loggers = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] barbican_service_user.timeout = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.approle_role_id = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.approle_secret_id = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.kv_mountpoint = secret {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.kv_path = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.kv_version = 2 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.namespace = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.root_token_id = **** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.ssl_ca_crt_file = None {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.timeout = 60.0 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.use_ssl = False {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 10:31:58 devstack cinder-volume[86909]: DEBUG oslo_service.backend._eventlet.service [None req-20ee180f-2e37-40eb-a946-b837049e0b2f None None] ******************************************************************************** {{(pid=86909) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 10:31:59 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.126s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:59 devstack cinder-volume[87208]: INFO cinder.volume.driver [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Driver hasn't implemented _init_vendor_properties() Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.volume.driver [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87208) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writer thread running {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.db.api [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Building query based on filter {{(pid=87208) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87208) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:59 devstack cinder-volume[87208]: INFO cinder.keymgr.migration [None req-ff495cde-3b22-4a93-9df1-b789bb58a7e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 10:31:59 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:31:59 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:31:59 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.616s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:31:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Driver initialization completed successfully. Jul 07 10:31:59 devstack cinder-volume[87208]: INFO cinder.manager [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Initiating service 3 cleanup Jul 07 10:31:59 devstack cinder-volume[87208]: INFO cinder.manager [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Service 3 cleanup completed. Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.service [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Creating RPC server for service cinder-volume {{(pid=87208) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.service [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87208) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 10:31:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:31:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:31:59 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:31:59 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:32:00 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Jul 07 10:32:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.624s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:32:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d2252c8d-d5ea-41d6-8845-c2ebe5e51c1e None None] Driver post RPC initialization completed successfully. Jul 07 10:32:07 devstack cinder-volume[86909]: DEBUG dbcounter [-] [86909] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86909) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:32:09 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:32:10 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:32:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:32:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 6 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:32:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Flow 'volume_create_manager' (ba5a8446-ec7c-4740-a4fc-f36837adc97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5cac4f-39f0-4a72-a087-f1390b46aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5cac4f-39f0-4a72-a087-f1390b46aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1051821382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bb8f6d-8e0b-4481-9058-569a243ac5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a3590fa5c048069ad5188e26f01301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:33:21Z,use_quota=True,user_id='b8d8ef6514d74f89bd6735d9f031240e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e0a5c1-ed4d-45c5-b3d6-177176cb65f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e0a5c1-ed4d-45c5-b3d6-177176cb65f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193ba81e-e7fd-4740-b9a5-6c4232e0af72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193ba81e-e7fd-4740-b9a5-6c4232e0af72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9bb8f6d-8e0b-4481-9058-569a243ac5d7', 'volume_name': 'volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebee8f7-2d47-4335-be32-464730866cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebee8f7-2d47-4335-be32-464730866cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13ba905-524b-43ad-89c6-43a01132af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:20 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Volume f9bb8f6d-8e0b-4481-9058-569a243ac5d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7', 'volume_size': 1} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1051821382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bb8f6d-8e0b-4481-9058-569a243ac5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a3590fa5c048069ad5188e26f01301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:33:21Z,use_quota=True,user_id='b8d8ef6514d74f89bd6735d9f031240e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Creating volume f9bb8f6d-8e0b-4481-9058-569a243ac5d7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:33:20 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:33:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:21 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 1073741824 Jul 07 10:33:21 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:23 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 1073741824" returned: 0 in 2.115s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:23 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 Jul 07 10:33:23 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:23 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:33:23 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:24 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7" returned: 0 in 1.450s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] <== create_volume: return (3735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:33:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.747s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13ba905-524b-43ad-89c6-43a01132af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fc0f65-21ee-4043-8c7d-f4bb5e67c963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Volume volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 (f9bb8f6d-8e0b-4481-9058-569a243ac5d7): created successfully Jul 07 10:33:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fc0f65-21ee-4043-8c7d-f4bb5e67c963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Flow 'volume_create_manager' (ba5a8446-ec7c-4740-a4fc-f36837adc97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:33:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-685a4f74-71b5-4003-8ddf-f4d7f22d404e tempest-DeleteServersTestJSON-1414699243 None] Created volume successfully. Jul 07 10:33:25 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.524s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:25 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:33:25 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:33:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 6 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:33:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Flow 'volume_create_manager' (6335864c-6326-4445-a196-b517f1f6526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f39ac2-6041-468f-a943-4d67363a595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f39ac2-6041-468f-a943-4d67363a595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-647999635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df03f497-1ce5-4763-b060-108575405c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26694785ef4143e38797b6188b5d34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:33:27Z,use_quota=True,user_id='257d6d3e7fe34e8bb37440fc21ce6d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de7e73e-3b30-43e7-ae70-4aa2fc85467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de7e73e-3b30-43e7-ae70-4aa2fc85467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c083c278-a209-4661-8631-a36ba2cdadfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c083c278-a209-4661-8631-a36ba2cdadfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df03f497-1ce5-4763-b060-108575405c1d', 'volume_name': 'volume-df03f497-1ce5-4763-b060-108575405c1d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d9f52-d645-4fc6-8809-9f2cc89f2ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d9f52-d645-4fc6-8809-9f2cc89f2ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df3aa70-9583-4043-bb64-31c79293c31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:26 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Volume df03f497-1ce5-4763-b060-108575405c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df03f497-1ce5-4763-b060-108575405c1d', 'volume_size': 1} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-647999635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df03f497-1ce5-4763-b060-108575405c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26694785ef4143e38797b6188b5d34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:33:27Z,use_quota=True,user_id='257d6d3e7fe34e8bb37440fc21ce6d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Creating volume df03f497-1ce5-4763-b060-108575405c1d {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:33:26 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:33:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:27 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d 1073741824 Jul 07 10:33:27 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:29 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d 1073741824" returned: 0 in 2.147s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:29 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d Jul 07 10:33:29 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:30 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d" returned: 0 in 1.100s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] <== create_volume: return (3321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:33:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.323s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df3aa70-9583-4043-bb64-31c79293c31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df03f497-1ce5-4763-b060-108575405c1d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a0c1c-deda-407f-a0e2-f92bf9ca6519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:30 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Volume volume-df03f497-1ce5-4763-b060-108575405c1d (df03f497-1ce5-4763-b060-108575405c1d): created successfully Jul 07 10:33:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a0c1c-deda-407f-a0e2-f92bf9ca6519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Flow 'volume_create_manager' (6335864c-6326-4445-a196-b517f1f6526e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:33:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3d44317f-c792-4025-8a22-a21404b2dcf5 tempest-VolumesAdminNegativeTest-2073728173 None] Created volume successfully. Jul 07 10:33:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Acquiring lock "cinder-df03f497-1ce5-4763-b060-108575405c1d-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:33:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "cinder-df03f497-1ce5-4763-b060-108575405c1d-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:33:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Acquiring lock "cinder-quobyte-df03f497-1ce5-4763-b060-108575405c1d" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:33:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "cinder-quobyte-df03f497-1ce5-4763-b060-108575405c1d" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:33:32 devstack cinder-volume[87208]: INFO oslo.privsep.daemon [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw8nx9iy4/privsep.sock'] Jul 07 10:33:32 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw8nx9iy4/privsep.sock Jul 07 10:33:32 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 10:33:33 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 10:33:34 devstack cinder-volume[87208]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 10:33:35 devstack cinder-volume[87208]: WARNING py.warnings [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 10:33:35 devstack cinder-volume[87208]: .first() Jul 07 10:33:35 devstack cinder-volume[87208]: Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:35 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:35 devstack cinder-volume[87208]: INFO oslo.privsep.daemon [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Spawned new privsep daemon via rootwrap Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Accepted privsep connection to /tmp/tmpw8nx9iy4/privsep.sock {{(pid=87208) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 10:33:35 devstack cinder-volume[87208]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 10:33:35 devstack cinder-volume[87208]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 10:33:35 devstack cinder-volume[87208]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 10:33:35 devstack cinder-volume[87208]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88321 Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e3b18-dffe-40b0-871b-138ed57cbfa1]: (2,) {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:33:35 devstack cinder-volume[87208]: WARNING oslo_privsep.priv_context [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] privsep daemon already running Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0475e5-1d19-4e33-b3ee-020183a8ffb8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe7e6f-5f6f-4cfc-a46c-109046112785]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:35 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 Jul 07 10:33:35 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:35 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d Jul 07 10:33:35 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Flow 'volume_create_manager' (c3ba5c26-2c88-40c5-beeb-114e26bd572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36185d7f-aa43-4f05-8d18-f6482947355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36185d7f-aa43-4f05-8d18-f6482947355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-227314707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c28e087-1641-4af5-95c0-05899f700f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b7a904e893485e8819e7f27e850516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:33:36Z,use_quota=True,user_id='740856b2941f4270b2847600e955f418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fa4dc5-2e40-4447-9f58-d64712d30659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fa4dc5-2e40-4447-9f58-d64712d30659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a976ec-6dd4-45df-89a4-636461bb0750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a976ec-6dd4-45df-89a4-636461bb0750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c28e087-1641-4af5-95c0-05899f700f91', 'volume_name': 'volume-1c28e087-1641-4af5-95c0-05899f700f91', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4289990-1cb3-4286-b114-b6598865c992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4289990-1cb3-4286-b114-b6598865c992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edc56b2-bf39-49c0-8914-64f6428eac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Volume 1c28e087-1641-4af5-95c0-05899f700f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c28e087-1641-4af5-95c0-05899f700f91', 'volume_size': 1} Jul 07 10:33:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:37 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d" returned: 0 in 1.720s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:37 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d Jul 07 10:33:37 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:37 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7" returned: 0 in 1.884s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.096s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-227314707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c28e087-1641-4af5-95c0-05899f700f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b7a904e893485e8819e7f27e850516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:33:36Z,use_quota=True,user_id='740856b2941f4270b2847600e955f418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Creating volume 1c28e087-1641-4af5-95c0-05899f700f91 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:33:37 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:37 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 1073741824 Jul 07 10:33:37 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49a18f86-af54-4b1b-8048-516615016a03', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:33:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-d0e0c2bb-c61f-4e99-be01-3e533e8fda08 req-a8e57bee-8d5e-4521-94d9-9ff620457d03 tempest-DeleteServersTestJSON-1414699243 None] attachment_update completed successfully. Jul 07 10:33:38 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-df03f497-1ce5-4763-b060-108575405c1d" returned: 0 in 1.441s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "cinder-quobyte-df03f497-1ce5-4763-b060-108575405c1d" released by "delete_volume" :: held 6.906s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:33:38 devstack cinder-volume[87208]: WARNING cinder.quota [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:33:39 devstack cinder-volume[87208]: WARNING cinder.quota [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:33:39 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Created reservations ['3677f0d1-1624-4035-bb22-29558df14c74', '1dc75078-71e9-47d5-a84c-8e268a74b40a', 'a5efdbd7-6661-4b3f-b067-3ea69707141d', 'b7006fc4-5b64-4aed-b7da-b53a397629a8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:33:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:33:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:33:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:39 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:33:39 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:40 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 1073741824" returned: 0 in 2.871s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:40 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 Jul 07 10:33:40 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:42 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 2.840s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:33:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Deleted volume successfully. Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0948b769-641d-4e58-a3ae-4fb4d0da4101 tempest-VolumesAdminNegativeTest-2073728173 None] Lock "cinder-df03f497-1ce5-4763-b060-108575405c1d-delete_volume" released by "delete_volume" :: held 10.505s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:33:42 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91" returned: 0 in 2.049s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] <== create_volume: return (5164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.171s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edc56b2-bf39-49c0-8914-64f6428eac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c28e087-1641-4af5-95c0-05899f700f91', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faa4568-844a-4ef7-a206-f0b464a59d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:33:42 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Volume volume-1c28e087-1641-4af5-95c0-05899f700f91 (1c28e087-1641-4af5-95c0-05899f700f91): created successfully Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faa4568-844a-4ef7-a206-f0b464a59d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:33:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Flow 'volume_create_manager' (c3ba5c26-2c88-40c5-beeb-114e26bd572e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:33:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6d7f1f48-9399-4523-aed9-2ebb2d369db1 tempest-ServerRescueNegativeTestJSON-1402037340 None] Created volume successfully. Jul 07 10:33:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-1f92512a-7da4-4ce8-8ec8-e4893d6f411a req-dc31a75f-028d-42c8-b0be-3ff737655828 tempest-DeleteServersTestJSON-1414699243 None] Terminate volume connection completed successfully. Jul 07 10:33:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-1f92512a-7da4-4ce8-8ec8-e4893d6f411a req-dc31a75f-028d-42c8-b0be-3ff737655828 tempest-DeleteServersTestJSON-1414699243 None] Deleting attachment 49a18f86-af54-4b1b-8048-516615016a03. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:33:52 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=15,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:33:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Acquiring lock "cinder-f9bb8f6d-8e0b-4481-9058-569a243ac5d7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:33:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Lock "cinder-f9bb8f6d-8e0b-4481-9058-569a243ac5d7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:33:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Acquiring lock "cinder-quobyte-f9bb8f6d-8e0b-4481-9058-569a243ac5d7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:33:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Lock "cinder-quobyte-f9bb8f6d-8e0b-4481-9058-569a243ac5d7" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:33:54 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3365598-bdfb-477a-abf3-bd0741b677dd]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:33:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:55 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 Jul 07 10:33:55 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:55 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7" returned: 0 in 0.914s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:55 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7 Jul 07 10:33:55 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:57 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f9bb8f6d-8e0b-4481-9058-569a243ac5d7" returned: 0 in 1.183s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Lock "cinder-quobyte-f9bb8f6d-8e0b-4481-9058-569a243ac5d7" released by "delete_volume" :: held 2.174s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Created reservations ['66b97c2b-46e2-4713-8c6f-3be7746140ab', '372a7113-ce23-4d60-b3c3-c5ad787ed30a', '483780cc-f299-4cfd-8a00-225aa73adbd7', 'fb0b2bf5-a929-4831-8072-176934d52a8e'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:33:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:33:57 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:33:57 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:33:58 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Jul 07 10:33:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.027s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:33:58 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:33:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Deleted volume successfully. Jul 07 10:33:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db33ebd9-38c3-493c-93d5-6ca84dae7b01 tempest-DeleteServersTestJSON-1414699243 None] Lock "cinder-f9bb8f6d-8e0b-4481-9058-569a243ac5d7-delete_volume" released by "delete_volume" :: held 3.596s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:34:10 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:34:10 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Flow 'volume_create_manager' (1c6c25f7-412a-4e08-9530-f3e71117a32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fca5d4-ec75-430d-a226-6845aa8abbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Acquiring lock "cinder-1c28e087-1641-4af5-95c0-05899f700f91-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fca5d4-ec75-430d-a226-6845aa8abbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-800826671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1592c946-519b-4ad5-8654-2ea97d127859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1e23d3eb744d6a8dea0234c4788dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:34:17Z,use_quota=True,user_id='c24b951242cc4bb38ccf821323c2788d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99184f8-bffa-46c1-900f-aaa0490ad23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99184f8-bffa-46c1-900f-aaa0490ad23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2d8102-1cdf-447b-894f-fb24ceae3dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2d8102-1cdf-447b-894f-fb24ceae3dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1592c946-519b-4ad5-8654-2ea97d127859', 'volume_name': 'volume-1592c946-519b-4ad5-8654-2ea97d127859', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479dae7a-8cf7-440b-ab60-3719a2a234fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479dae7a-8cf7-440b-ab60-3719a2a234fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1406bbe-cd9c-4611-9668-045ab1195ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:34:17 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Volume 1592c946-519b-4ad5-8654-2ea97d127859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1592c946-519b-4ad5-8654-2ea97d127859', 'volume_size': 1} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-800826671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1592c946-519b-4ad5-8654-2ea97d127859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1e23d3eb744d6a8dea0234c4788dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:34:17Z,use_quota=True,user_id='c24b951242cc4bb38ccf821323c2788d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Creating volume 1592c946-519b-4ad5-8654-2ea97d127859 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:34:17 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:34:17 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 1073741824 Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "cinder-1c28e087-1641-4af5-95c0-05899f700f91-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:34:17 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Acquiring lock "cinder-quobyte-1c28e087-1641-4af5-95c0-05899f700f91" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "cinder-quobyte-1c28e087-1641-4af5-95c0-05899f700f91" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6afaa2-c267-41aa-a917-9322435f3ba7]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:34:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:34:17 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 Jul 07 10:34:17 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:34:18 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Jul 07 10:34:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 1073741824" returned: 0 in 1.267s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:34:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:34:18 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 Jul 07 10:34:18 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:34:19 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91" returned: 0 in 1.380s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:34:19 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91 Jul 07 10:34:19 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:34:19 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859" returned: 0 in 0.839s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1406bbe-cd9c-4611-9668-045ab1195ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1592c946-519b-4ad5-8654-2ea97d127859', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7a6818-f290-45c1-9a4c-5ded447012c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:34:19 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Volume volume-1592c946-519b-4ad5-8654-2ea97d127859 (1592c946-519b-4ad5-8654-2ea97d127859): created successfully Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7a6818-f290-45c1-9a4c-5ded447012c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:34:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Flow 'volume_create_manager' (1c6c25f7-412a-4e08-9530-f3e71117a32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:34:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0fae8805-4fab-4c06-aa9d-8061af8d3ae0 tempest-TaggedAttachmentsTest-868723327 None] Created volume successfully. Jul 07 10:34:20 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1c28e087-1641-4af5-95c0-05899f700f91" returned: 0 in 1.149s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "cinder-quobyte-1c28e087-1641-4af5-95c0-05899f700f91" released by "delete_volume" :: held 2.604s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Created reservations ['ece1f3b5-1f7e-43de-8e59-85feda993975', 'f5423826-e44b-48f3-af91-f601ae514fec', '3c4d1df0-66fe-4844-8fe2-dfaaa0adf064', '452c8765-a8f1-4b08-a6b6-bfa45779c53c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:34:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:34:20 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:34:20 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:34:21 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jul 07 10:34:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.282s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:34:21 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:34:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Deleted volume successfully. Jul 07 10:34:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0a6c77bc-56c9-4eb7-9954-7b4778bca597 tempest-ServerRescueNegativeTestJSON-1402037340 None] Lock "cinder-1c28e087-1641-4af5-95c0-05899f700f91-delete_volume" released by "delete_volume" :: held 4.212s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:34:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:34:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:34:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:34:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:34:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:34:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:34:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:34:23 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:34:23 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:34:24 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Jul 07 10:34:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.898s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:34:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:34:30 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:34:31 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Flow 'volume_create_manager' (2629d847-a8a1-4aa5-9a0f-d96f4753aff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8494eba-af8d-47e2-bec8-dffa7821bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8494eba-af8d-47e2-bec8-dffa7821bc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1947751510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bcc693-3bb0-4e7c-87b7-85425dd18f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53faccd4c458400a854439933486ba89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:35:18Z,use_quota=True,user_id='2c38403f7aac47bfa29b443f596e666e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4e502f-4fa1-47f5-b4d5-9c9aac3566d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4e502f-4fa1-47f5-b4d5-9c9aac3566d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc3deb7-0356-4cb4-ad54-3c2e69544d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc3deb7-0356-4cb4-ad54-3c2e69544d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bcc693-3bb0-4e7c-87b7-85425dd18f7d', 'volume_name': 'volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7372713-93e0-4506-a00a-d829e59a7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7372713-93e0-4506-a00a-d829e59a7d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7d01d9-5b6e-4f77-a1e5-6535ab3a0f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:18 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Volume b5bcc693-3bb0-4e7c-87b7-85425dd18f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d', 'volume_size': 1} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1947751510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bcc693-3bb0-4e7c-87b7-85425dd18f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53faccd4c458400a854439933486ba89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:35:18Z,use_quota=True,user_id='2c38403f7aac47bfa29b443f596e666e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Creating volume b5bcc693-3bb0-4e7c-87b7-85425dd18f7d {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:35:18 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:35:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:18 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d 1073741824 Jul 07 10:35:18 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:19 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d 1073741824" returned: 0 in 1.186s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:19 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d Jul 07 10:35:19 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:20 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d" returned: 0 in 0.908s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:35:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7d01d9-5b6e-4f77-a1e5-6535ab3a0f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a3d029-e82a-43e2-b165-6b39a0e0c765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:20 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Volume volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d (b5bcc693-3bb0-4e7c-87b7-85425dd18f7d): created successfully Jul 07 10:35:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a3d029-e82a-43e2-b165-6b39a0e0c765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Flow 'volume_create_manager' (2629d847-a8a1-4aa5-9a0f-d96f4753aff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:35:20 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-cabc2fa1-9ec9-4258-a341-a79caae35ce1 tempest-AttachVolumeShelveTestJSON-1360396758 None] Created volume successfully. Jul 07 10:35:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:35:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:35:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:35:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:23 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:35:23 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:24 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.052s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:35:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:35:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 8 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:35:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:35:30 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:35:30 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:35:31 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:35:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Flow 'volume_create_manager' (1a919f4c-ae74-4ce0-a8cc-b5f639bc0282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:35:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7af2635-9f3b-4f9f-88d6-ae4518f0b5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7af2635-9f3b-4f9f-88d6-ae4518f0b5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2064302367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eea429-9d01-4ca2-8b83-af64228c810a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e539d26c5046e89f7dfd9870669bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:35:32Z,use_quota=True,user_id='bd12de40974b4e11ac2655a1541eb3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cebd2c-78ec-4ef5-8519-c82e2c89fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cebd2c-78ec-4ef5-8519-c82e2c89fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c99055-4ed8-4b11-912d-da618630afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c99055-4ed8-4b11-912d-da618630afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50eea429-9d01-4ca2-8b83-af64228c810a', 'volume_name': 'volume-50eea429-9d01-4ca2-8b83-af64228c810a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98631b36-27f1-4665-a010-99606e0394ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98631b36-27f1-4665-a010-99606e0394ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67b16ca-9e17-40fd-aa1d-4101aec2bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:32 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Volume 50eea429-9d01-4ca2-8b83-af64228c810a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50eea429-9d01-4ca2-8b83-af64228c810a', 'volume_size': 1} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2064302367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eea429-9d01-4ca2-8b83-af64228c810a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e539d26c5046e89f7dfd9870669bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:35:32Z,use_quota=True,user_id='bd12de40974b4e11ac2655a1541eb3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Creating volume 50eea429-9d01-4ca2-8b83-af64228c810a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:35:32 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-382708ed-8fe1-4f4a-8d77-2386fba4caf7 req-40e493b6-7521-4017-9e92-8a08d75e4003 tempest-TaggedAttachmentsTest-868723327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:32 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a 1073741824 Jul 07 10:35:32 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:33 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a 1073741824" returned: 0 in 1.137s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:33 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a Jul 07 10:35:33 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:34 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a" returned: 0 in 0.778s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-382708ed-8fe1-4f4a-8d77-2386fba4caf7 req-40e493b6-7521-4017-9e92-8a08d75e4003 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.937s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67b16ca-9e17-40fd-aa1d-4101aec2bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50eea429-9d01-4ca2-8b83-af64228c810a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b75208-7d57-4f31-b28b-f97d15838e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31f52e6-517a-4104-b8ba-62e48cb86234]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-382708ed-8fe1-4f4a-8d77-2386fba4caf7 req-40e493b6-7521-4017-9e92-8a08d75e4003 tempest-TaggedAttachmentsTest-868723327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:34 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Volume volume-50eea429-9d01-4ca2-8b83-af64228c810a (50eea429-9d01-4ca2-8b83-af64228c810a): created successfully Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b75208-7d57-4f31-b28b-f97d15838e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Flow 'volume_create_manager' (1a919f4c-ae74-4ce0-a8cc-b5f639bc0282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:35:34 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5a0e0092-a1db-47a8-8c07-c5b8c01f003d tempest-ServerActionsTestOtherA-479937904 None] Created volume successfully. Jul 07 10:35:34 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 Jul 07 10:35:34 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:35 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-382708ed-8fe1-4f4a-8d77-2386fba4caf7 req-40e493b6-7521-4017-9e92-8a08d75e4003 tempest-TaggedAttachmentsTest-868723327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859" returned: 0 in 0.974s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-382708ed-8fe1-4f4a-8d77-2386fba4caf7 req-40e493b6-7521-4017-9e92-8a08d75e4003 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.018s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-382708ed-8fe1-4f4a-8d77-2386fba4caf7 req-40e493b6-7521-4017-9e92-8a08d75e4003 tempest-TaggedAttachmentsTest-868723327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-1592c946-519b-4ad5-8654-2ea97d127859', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e894c67-492a-451e-8aff-34659f161aa2', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:35:35 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-382708ed-8fe1-4f4a-8d77-2386fba4caf7 req-40e493b6-7521-4017-9e92-8a08d75e4003 tempest-TaggedAttachmentsTest-868723327 None] attachment_update completed successfully. Jul 07 10:35:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-b511ca26-94bc-477c-8752-a8e39be24e80 req-9aaad50b-d9fb-48cc-b52e-dda7ba87df43 tempest-AttachVolumeShelveTestJSON-1360396758 None] No connector for attachment a16ee9e5-513c-446c-8193-6e040b9a1110; skipping storage backend terminate_connection call. {{(pid=87208) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 10:35:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-b511ca26-94bc-477c-8752-a8e39be24e80 req-9aaad50b-d9fb-48cc-b52e-dda7ba87df43 tempest-AttachVolumeShelveTestJSON-1360396758 None] Deleting attachment a16ee9e5-513c-446c-8193-6e040b9a1110. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:35:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-28c7cea0-c10a-4ef8-b138-1a2b9f5c4cdc req-7964a1f6-12e6-4c18-8fa7-f2d547b61d50 tempest-TaggedAttachmentsTest-868723327 None] Terminate volume connection completed successfully. Jul 07 10:35:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-28c7cea0-c10a-4ef8-b138-1a2b9f5c4cdc req-7964a1f6-12e6-4c18-8fa7-f2d547b61d50 tempest-TaggedAttachmentsTest-868723327 None] Deleting attachment 4e894c67-492a-451e-8aff-34659f161aa2. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Flow 'volume_create_manager' (46a0755c-555f-4d2c-8687-e39af462bb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edb52bc-df05-46ca-a5d7-6cb7f6060be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edb52bc-df05-46ca-a5d7-6cb7f6060be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2019870885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba7c009-10ec-431d-b426-dc230f2ec4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef8718e7c164a22a98c247edb5b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:35:46Z,use_quota=True,user_id='3d4f44eedd734405a339f04a133723b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53659249-f36a-4f0b-89cd-0f9a2c82e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53659249-f36a-4f0b-89cd-0f9a2c82e668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eee96c-a1f5-4426-8f8f-cfd1bc4366f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eee96c-a1f5-4426-8f8f-cfd1bc4366f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba7c009-10ec-431d-b426-dc230f2ec4e6', 'volume_name': 'volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a6dbbb-06e9-4f36-b784-080cef0de028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a6dbbb-06e9-4f36-b784-080cef0de028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998018c3-3139-4f80-baea-cc8471bb9a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:46 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Volume 3ba7c009-10ec-431d-b426-dc230f2ec4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6', 'volume_size': 1} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2019870885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba7c009-10ec-431d-b426-dc230f2ec4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef8718e7c164a22a98c247edb5b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:35:46Z,use_quota=True,user_id='3d4f44eedd734405a339f04a133723b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Creating volume 3ba7c009-10ec-431d-b426-dc230f2ec4e6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:35:46 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:35:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:46 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 1073741824 Jul 07 10:35:46 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:47 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 1073741824" returned: 0 in 1.016s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:47 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 Jul 07 10:35:47 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:48 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6" returned: 0 in 0.906s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:35:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998018c3-3139-4f80-baea-cc8471bb9a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5865ddfc-50aa-442a-875b-962990c85e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:35:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Volume volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 (3ba7c009-10ec-431d-b426-dc230f2ec4e6): created successfully Jul 07 10:35:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5865ddfc-50aa-442a-875b-962990c85e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:35:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Flow 'volume_create_manager' (46a0755c-555f-4d2c-8687-e39af462bb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:35:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fa7da898-4b20-4363-9ecf-d0e729573669 tempest-AttachVolumeNegativeTest-1491468132 None] Created volume successfully. Jul 07 10:35:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7372d6e0-3f7f-4f4c-9328-4eac5bd0fc11 req-c05102b3-2c19-4abf-975f-600d23430dd7 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:35:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7372d6e0-3f7f-4f4c-9328-4eac5bd0fc11 req-c05102b3-2c19-4abf-975f-600d23430dd7 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:35:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d9b30-f035-4854-aed7-1d766ad8cf4b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:35:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7372d6e0-3f7f-4f4c-9328-4eac5bd0fc11 req-c05102b3-2c19-4abf-975f-600d23430dd7 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:35:53 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 Jul 07 10:35:53 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:35:54 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Jul 07 10:35:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7372d6e0-3f7f-4f4c-9328-4eac5bd0fc11 req-c05102b3-2c19-4abf-975f-600d23430dd7 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6" returned: 0 in 1.479s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:35:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7372d6e0-3f7f-4f4c-9328-4eac5bd0fc11 req-c05102b3-2c19-4abf-975f-600d23430dd7 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.515s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:35:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-7372d6e0-3f7f-4f4c-9328-4eac5bd0fc11 req-c05102b3-2c19-4abf-975f-600d23430dd7 tempest-AttachVolumeNegativeTest-1491468132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '590d6b2a-8668-46b3-960a-c9d764f9f0c1', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:35:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-7372d6e0-3f7f-4f4c-9328-4eac5bd0fc11 req-c05102b3-2c19-4abf-975f-600d23430dd7 tempest-AttachVolumeNegativeTest-1491468132 None] attachment_update completed successfully. Jul 07 10:36:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Acquiring lock "cinder-1592c946-519b-4ad5-8654-2ea97d127859-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:36:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Lock "cinder-1592c946-519b-4ad5-8654-2ea97d127859-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:36:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Acquiring lock "cinder-quobyte-1592c946-519b-4ad5-8654-2ea97d127859" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:36:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Lock "cinder-quobyte-1592c946-519b-4ad5-8654-2ea97d127859" acquired by "delete_volume" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:36:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[82704b5a-62a1-4b6b-b89e-33102742a286]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:36:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:04 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 Jul 07 10:36:04 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:05 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:05 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859 Jul 07 10:36:05 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:05 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1592c946-519b-4ad5-8654-2ea97d127859" returned: 0 in 0.691s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Lock "cinder-quobyte-1592c946-519b-4ad5-8654-2ea97d127859" released by "delete_volume" :: held 1.561s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:36:05 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Created reservations ['028bc0f8-2900-4797-a1e9-82ac881b9137', 'd9786a36-64d7-457f-a57d-8b36a7db8606', 'c73a14d0-a04e-4b87-afa9-9ed8dae3f0fe', 'f28a84f3-0fc6-4d1f-ac09-e5b976f2947c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:06 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:36:06 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:06 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.677s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:36:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Deleted volume successfully. Jul 07 10:36:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e4e438a3-fd66-4654-a02f-911815c94b98 tempest-TaggedAttachmentsTest-868723327 None] Lock "cinder-1592c946-519b-4ad5-8654-2ea97d127859-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:36:16 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=21,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:36:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-499e7083-a984-48c6-9064-35a6e8db0414 req-1861ff7f-c8a4-4f24-b4d9-5493bb947597 tempest-ServerActionsTestOtherA-479937904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:36:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-499e7083-a984-48c6-9064-35a6e8db0414 req-1861ff7f-c8a4-4f24-b4d9-5493bb947597 tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:36:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c8371d-8d2f-4dfe-9918-e963d1c397f1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:36:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-499e7083-a984-48c6-9064-35a6e8db0414 req-1861ff7f-c8a4-4f24-b4d9-5493bb947597 tempest-ServerActionsTestOtherA-479937904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:16 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a Jul 07 10:36:16 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:17 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-499e7083-a984-48c6-9064-35a6e8db0414 req-1861ff7f-c8a4-4f24-b4d9-5493bb947597 tempest-ServerActionsTestOtherA-479937904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-499e7083-a984-48c6-9064-35a6e8db0414 req-1861ff7f-c8a4-4f24-b4d9-5493bb947597 tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:36:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-499e7083-a984-48c6-9064-35a6e8db0414 req-1861ff7f-c8a4-4f24-b4d9-5493bb947597 tempest-ServerActionsTestOtherA-479937904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-50eea429-9d01-4ca2-8b83-af64228c810a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25410866-a7c0-4d9d-8633-a3037a93dec3', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:36:17 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-499e7083-a984-48c6-9064-35a6e8db0414 req-1861ff7f-c8a4-4f24-b4d9-5493bb947597 tempest-ServerActionsTestOtherA-479937904 None] attachment_update completed successfully. Jul 07 10:36:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:36:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:36:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:36:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:36:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:36:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:36:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:23 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:36:23 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:24 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.881s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:36:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-50c1b535-c769-49d4-9b08-07859fd797fc req-5dc0fe88-255c-4e35-81ae-9d8391986c69 tempest-ServerActionsTestOtherA-479937904 None] Terminate volume connection completed successfully. Jul 07 10:36:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-50c1b535-c769-49d4-9b08-07859fd797fc req-5dc0fe88-255c-4e35-81ae-9d8391986c69 tempest-ServerActionsTestOtherA-479937904 None] Deleting attachment 25410866-a7c0-4d9d-8633-a3037a93dec3. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:36:27 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=22,cinder:SELECT=30,cinder:INSERT=2,cinder:DELETE=3 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:36:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-50c1b535-c769-49d4-9b08-07859fd797fc req-12c6feec-1a44-4b97-b04a-fda8443f43de tempest-ServerActionsTestOtherA-479937904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:36:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-50c1b535-c769-49d4-9b08-07859fd797fc req-12c6feec-1a44-4b97-b04a-fda8443f43de tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:36:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5033ba1e-9c84-450e-8afb-64c64ca35c7b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:36:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-50c1b535-c769-49d4-9b08-07859fd797fc req-12c6feec-1a44-4b97-b04a-fda8443f43de tempest-ServerActionsTestOtherA-479937904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:29 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a Jul 07 10:36:29 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:30 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-50c1b535-c769-49d4-9b08-07859fd797fc req-12c6feec-1a44-4b97-b04a-fda8443f43de tempest-ServerActionsTestOtherA-479937904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a" returned: 0 in 1.040s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-50c1b535-c769-49d4-9b08-07859fd797fc req-12c6feec-1a44-4b97-b04a-fda8443f43de tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:36:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-50c1b535-c769-49d4-9b08-07859fd797fc req-12c6feec-1a44-4b97-b04a-fda8443f43de tempest-ServerActionsTestOtherA-479937904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-50eea429-9d01-4ca2-8b83-af64228c810a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ec92e62-d1f5-4756-9029-1e53ad33a1c5', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:36:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-50c1b535-c769-49d4-9b08-07859fd797fc req-12c6feec-1a44-4b97-b04a-fda8443f43de tempest-ServerActionsTestOtherA-479937904 None] attachment_update completed successfully. Jul 07 10:36:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Acquiring lock "cinder-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:36:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "cinder-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:36:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Acquiring lock "cinder-quobyte-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:36:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "cinder-quobyte-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:36:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b579e495-b2ef-4204-9b68-92428243db84]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:36:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:33 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d Jul 07 10:36:33 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:34 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d" returned: 0 in 1.013s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:34 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d Jul 07 10:36:34 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:35 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d" returned: 0 in 0.783s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "cinder-quobyte-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d" released by "delete_volume" :: held 1.866s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Created reservations ['eb6fa4fe-ee30-4baf-b58b-826f47b5d97e', '877214a0-855c-4099-9fcd-f2f67c6e3c38', 'b4fc9d35-7967-410b-9967-fcffe886a150', '415cf7fc-50c3-4083-a297-e12e2013063d'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:36:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:35 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:36:35 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:36 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.758s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:36 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:36:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Deleted volume successfully. Jul 07 10:36:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cc845537-fc8d-47e9-98d7-817fdd3cddc9 tempest-AttachVolumeShelveTestJSON-1360396758 None] Lock "cinder-b5bcc693-3bb0-4e7c-87b7-85425dd18f7d-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:36:45 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=20,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:36:46 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:36:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c0d7bc68-50a9-4756-ad2a-f0f13ffd370c tempest-GroupsTest-966988529 None] Group tempest-Group1-1622973897: creating Jul 07 10:36:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c0d7bc68-50a9-4756-ad2a-f0f13ffd370c tempest-GroupsTest-966988529 None] Group tempest-Group1-1622973897: created successfully Jul 07 10:36:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c0d7bc68-50a9-4756-ad2a-f0f13ffd370c tempest-GroupsTest-966988529 None] Create group completed successfully. Jul 07 10:36:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5694cd12-7c8a-4365-9e28-58a596ecd38c tempest-GroupsTest-966988529 None] Group tempest-Group2-1466751455: creating Jul 07 10:36:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5694cd12-7c8a-4365-9e28-58a596ecd38c tempest-GroupsTest-966988529 None] Group tempest-Group2-1466751455: created successfully Jul 07 10:36:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5694cd12-7c8a-4365-9e28-58a596ecd38c tempest-GroupsTest-966988529 None] Create group completed successfully. Jul 07 10:36:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-21fbca0e-3fbf-4743-9536-939082cbe872 req-dfa98f61-b20c-4b1a-8fa7-7677f9d6ca20 tempest-AttachVolumeNegativeTest-1491468132 None] Terminate volume connection completed successfully. Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-21fbca0e-3fbf-4743-9536-939082cbe872 req-dfa98f61-b20c-4b1a-8fa7-7677f9d6ca20 tempest-AttachVolumeNegativeTest-1491468132 None] Deleting attachment 590d6b2a-8668-46b3-960a-c9d764f9f0c1. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Flow 'volume_create_manager' (6465d52c-0937-49c0-b091-4d024ae47971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7464597-bf87-479c-bf5e-8651bb4f136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7464597-bf87-479c-bf5e-8651bb4f136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763523801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c90841d3-a52e-4260-a9b0-fdc5baa14f06,host='devstack@QuobyteHD#QuobyteHD',id=a0aae1aa-ed18-494d-b77d-53bb7aa3876a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caf21a030e4b6e886d2135e8f3310d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:36:56Z,use_quota=True,user_id='4dc238fd108642148685dbb2366bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f33a88-cc72-46e2-8cca-5edca4abc118),volume_type_id=96f33a88-cc72-46e2-8cca-5edca4abc118)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26046ab1-7f4d-46f2-8644-001777b7fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26046ab1-7f4d-46f2-8644-001777b7fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c6c902-6157-4d15-9bb5-53038af49233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c6c902-6157-4d15-9bb5-53038af49233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0aae1aa-ed18-494d-b77d-53bb7aa3876a', 'volume_name': 'volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f488335b-de2c-46a4-aa70-760ad6b2661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f488335b-de2c-46a4-aa70-760ad6b2661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8247e6-ab26-487e-a05e-49678c823d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:36:56 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Volume a0aae1aa-ed18-494d-b77d-53bb7aa3876a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a', 'volume_size': 1} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c90841d3-a52e-4260-a9b0-fdc5baa14f06,created_at=2026-07-07T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763523801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c90841d3-a52e-4260-a9b0-fdc5baa14f06,host='devstack@QuobyteHD#QuobyteHD',id=a0aae1aa-ed18-494d-b77d-53bb7aa3876a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caf21a030e4b6e886d2135e8f3310d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:36:56Z,use_quota=True,user_id='4dc238fd108642148685dbb2366bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f33a88-cc72-46e2-8cca-5edca4abc118),volume_type_id=96f33a88-cc72-46e2-8cca-5edca4abc118)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Creating volume a0aae1aa-ed18-494d-b77d-53bb7aa3876a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:36:56 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:36:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:56 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a 1073741824 Jul 07 10:36:56 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:57 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a 1073741824" returned: 0 in 0.999s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:36:57 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a Jul 07 10:36:57 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:36:58 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Jul 07 10:36:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a" returned: 0 in 0.848s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:36:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:36:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:36:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8247e6-ab26-487e-a05e-49678c823d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:36:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ffe646-9657-4495-9959-b81c814fe47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:36:58 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Volume volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a (a0aae1aa-ed18-494d-b77d-53bb7aa3876a): created successfully Jul 07 10:36:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ffe646-9657-4495-9959-b81c814fe47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:36:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Flow 'volume_create_manager' (6465d52c-0937-49c0-b091-4d024ae47971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:36:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-13ded1ce-30d4-449a-b184-346c51ccab8d tempest-GroupsTest-966988529 None] Created volume successfully. Jul 07 10:37:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Acquiring lock "cinder-quobyte-a0aae1aa-ed18-494d-b77d-53bb7aa3876a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Lock "cinder-quobyte-a0aae1aa-ed18-494d-b77d-53bb7aa3876a" acquired by "delete_volume" :: waited 0.069s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[48232981-50bf-48d9-8373-3780a997b1a0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:37:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:00 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a Jul 07 10:37:00 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:02 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a" returned: 0 in 2.025s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:02 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a Jul 07 10:37:02 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:03 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a0aae1aa-ed18-494d-b77d-53bb7aa3876a" returned: 0 in 1.348s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Lock "cinder-quobyte-a0aae1aa-ed18-494d-b77d-53bb7aa3876a" released by "delete_volume" :: held 3.551s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:03 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Created reservations ['8cca49cd-91ff-4577-8a64-c5d2f89d887f'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:03 devstack cinder-volume[87208]: WARNING cinder.quota [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-407550304 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-407550304, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:37:03 devstack cinder-volume[87208]: WARNING cinder.quota [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-407550304 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-407550304, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:37:03 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Created reservations ['4b2a55c9-716e-44fe-9866-21a24065094f', '9d40d1d8-4bef-4008-9161-b564113c62be', '1c287c79-78cf-4cbe-b07a-e8766fc2faf5', 'b212caf9-c0bd-4eec-846d-f79bf8793659'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-fb72b4bd-6acc-476c-a951-58c82f841a77 req-d46d662c-2b73-473d-a24b-777a3a02171f tempest-ServerActionsTestOtherA-479937904 None] Terminate volume connection completed successfully. Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-fb72b4bd-6acc-476c-a951-58c82f841a77 req-d46d662c-2b73-473d-a24b-777a3a02171f tempest-ServerActionsTestOtherA-479937904 None] Deleting attachment 1ec92e62-d1f5-4756-9029-1e53ad33a1c5. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:04 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:04 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Created reservations ['49bedc18-d5b7-4842-9986-9e1305dbf9bc'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:04 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:04 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:04 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.746s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:04 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-57bdb250-455f-4757-aa38-913079c86183 tempest-GroupsTest-966988529 None] Delete group completed successfully. Jul 07 10:37:05 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.796s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:05 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:05 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0eb92b0d-21fc-4375-87d5-be1f5dfc5a01 tempest-GroupsTest-966988529 None] Delete group completed successfully. Jul 07 10:37:05 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-beee7442-364c-4d4a-bf39-7effc50a07f1 tempest-GroupsTest-966988529 None] Group tempest-GroupsTest-Group-852625823: creating Jul 07 10:37:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-beee7442-364c-4d4a-bf39-7effc50a07f1 tempest-GroupsTest-966988529 None] Group tempest-GroupsTest-Group-852625823: created successfully Jul 07 10:37:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-beee7442-364c-4d4a-bf39-7effc50a07f1 tempest-GroupsTest-966988529 None] Create group completed successfully. Jul 07 10:37:07 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:37:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Flow 'volume_create_manager' (5728cd39-735b-4d6c-9533-243b2eb5e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8b58bf-1e43-4359-8d32-14ee267ef5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8b58bf-1e43-4359-8d32-14ee267ef5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-724105406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d40572a-9a95-4bb5-b328-b951f5f01f91,host='devstack@QuobyteHD#QuobyteHD',id=b10b1926-f0eb-4185-82cd-8777523c10c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caf21a030e4b6e886d2135e8f3310d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:08Z,use_quota=True,user_id='4dc238fd108642148685dbb2366bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1827f12-7296-469b-9b44-be1d7a1118ea),volume_type_id=a1827f12-7296-469b-9b44-be1d7a1118ea)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fdba0f-dd4a-46a7-ac59-3e818e7284f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fdba0f-dd4a-46a7-ac59-3e818e7284f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab93782-59c0-40d6-8c26-fbfd8a80687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab93782-59c0-40d6-8c26-fbfd8a80687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10b1926-f0eb-4185-82cd-8777523c10c0', 'volume_name': 'volume-b10b1926-f0eb-4185-82cd-8777523c10c0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816d6537-4c73-4a5d-8026-df8b7ed805dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816d6537-4c73-4a5d-8026-df8b7ed805dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e4feb8-e552-4f69-86fc-7b5af7da073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:08 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Volume b10b1926-f0eb-4185-82cd-8777523c10c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10b1926-f0eb-4185-82cd-8777523c10c0', 'volume_size': 1} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d40572a-9a95-4bb5-b328-b951f5f01f91,created_at=2026-07-07T08:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-724105406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d40572a-9a95-4bb5-b328-b951f5f01f91,host='devstack@QuobyteHD#QuobyteHD',id=b10b1926-f0eb-4185-82cd-8777523c10c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caf21a030e4b6e886d2135e8f3310d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:08Z,use_quota=True,user_id='4dc238fd108642148685dbb2366bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1827f12-7296-469b-9b44-be1d7a1118ea),volume_type_id=a1827f12-7296-469b-9b44-be1d7a1118ea)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Creating volume b10b1926-f0eb-4185-82cd-8777523c10c0 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:37:08 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:37:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:08 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 1073741824 Jul 07 10:37:08 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:09 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 1073741824" returned: 0 in 1.112s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:09 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 Jul 07 10:37:09 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:10 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0" returned: 0 in 0.849s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:37:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e4feb8-e552-4f69-86fc-7b5af7da073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10b1926-f0eb-4185-82cd-8777523c10c0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714e2a85-e731-4b7d-8015-c6c22dd8351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:10 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Volume volume-b10b1926-f0eb-4185-82cd-8777523c10c0 (b10b1926-f0eb-4185-82cd-8777523c10c0): created successfully Jul 07 10:37:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714e2a85-e731-4b7d-8015-c6c22dd8351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Flow 'volume_create_manager' (5728cd39-735b-4d6c-9533-243b2eb5e255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:10 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-27de91e8-4f68-40d4-b70c-fb6600621f46 tempest-GroupsTest-966988529 None] Created volume successfully. Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Flow 'volume_create_manager' (f96bbef0-51a6-4c85-8819-7b3471071964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10239181-6df0-4062-b89b-bd798b87709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10239181-6df0-4062-b89b-bd798b87709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-638514248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d40572a-9a95-4bb5-b328-b951f5f01f91,host='devstack@QuobyteHD#QuobyteHD',id=808aa66b-9747-42e7-acd3-696aa1949384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caf21a030e4b6e886d2135e8f3310d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:11Z,use_quota=True,user_id='4dc238fd108642148685dbb2366bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1827f12-7296-469b-9b44-be1d7a1118ea),volume_type_id=a1827f12-7296-469b-9b44-be1d7a1118ea)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1172cf63-73f8-4c9e-8401-ce07acb83249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1172cf63-73f8-4c9e-8401-ce07acb83249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c45e9-552a-48ab-aa4d-6ab36660f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c45e9-552a-48ab-aa4d-6ab36660f173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808aa66b-9747-42e7-acd3-696aa1949384', 'volume_name': 'volume-808aa66b-9747-42e7-acd3-696aa1949384', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193f32a3-0242-410a-b4e1-5a886d6142f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193f32a3-0242-410a-b4e1-5a886d6142f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55097fa3-3526-4a8d-b889-cf9a4be23f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Volume 808aa66b-9747-42e7-acd3-696aa1949384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808aa66b-9747-42e7-acd3-696aa1949384', 'volume_size': 1} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d40572a-9a95-4bb5-b328-b951f5f01f91,created_at=2026-07-07T08:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-638514248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d40572a-9a95-4bb5-b328-b951f5f01f91,host='devstack@QuobyteHD#QuobyteHD',id=808aa66b-9747-42e7-acd3-696aa1949384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caf21a030e4b6e886d2135e8f3310d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:11Z,use_quota=True,user_id='4dc238fd108642148685dbb2366bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1827f12-7296-469b-9b44-be1d7a1118ea),volume_type_id=a1827f12-7296-469b-9b44-be1d7a1118ea)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Creating volume 808aa66b-9747-42e7-acd3-696aa1949384 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:37:11 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:37:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:11 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 1073741824 Jul 07 10:37:11 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:13 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 1073741824" returned: 0 in 1.474s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:13 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 Jul 07 10:37:13 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:13 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384" returned: 0 in 0.822s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] <== create_volume: return (2370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:37:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55097fa3-3526-4a8d-b889-cf9a4be23f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808aa66b-9747-42e7-acd3-696aa1949384', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a40170b-f4d6-43d8-bb90-c1ed2a7838e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:14 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Volume volume-808aa66b-9747-42e7-acd3-696aa1949384 (808aa66b-9747-42e7-acd3-696aa1949384): created successfully Jul 07 10:37:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a40170b-f4d6-43d8-bb90-c1ed2a7838e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Flow 'volume_create_manager' (f96bbef0-51a6-4c85-8819-7b3471071964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d4a6af8f-988d-4243-af17-04ad02705833 tempest-GroupsTest-966988529 None] Created volume successfully. Jul 07 10:37:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Acquiring lock "cinder-50eea429-9d01-4ca2-8b83-af64228c810a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Lock "cinder-50eea429-9d01-4ca2-8b83-af64228c810a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Acquiring lock "cinder-quobyte-50eea429-9d01-4ca2-8b83-af64228c810a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:15 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-94552788-cf32-4507-be63-73f3153ba8c1 tempest-GroupsTest-966988529 None] Update group completed successfully. Jul 07 10:37:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Lock "cinder-quobyte-50eea429-9d01-4ca2-8b83-af64228c810a" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:15 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6cdff0-e98a-4096-80d8-b0358ca2496e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:37:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:15 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a Jul 07 10:37:15 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:16 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a" returned: 0 in 0.862s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:16 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a Jul 07 10:37:16 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:17 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0f4ccc0d-19f8-4e5b-aa33-7f55d41faf3f tempest-GroupsTest-966988529 None] Update group completed successfully. Jul 07 10:37:17 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-50eea429-9d01-4ca2-8b83-af64228c810a" returned: 0 in 0.776s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Lock "cinder-quobyte-50eea429-9d01-4ca2-8b83-af64228c810a" released by "delete_volume" :: held 1.698s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Created reservations ['906fe87c-bdd6-488e-a4d5-0bae6c2c0bdf', '9643f21b-10e4-489b-a7f0-d16d59739bfc', '393c7242-f018-412a-acfa-4ff79047f2e5', 'e637a404-3c7d-4543-a3be-7bf014faba5d'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:17 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:17 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:18 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.663s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:18 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:18 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Deleted volume successfully. Jul 07 10:37:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7eaad30-566b-43eb-8123-12b40a00712d tempest-ServerActionsTestOtherA-479937904 None] Lock "cinder-50eea429-9d01-4ca2-8b83-af64228c810a-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Acquiring lock "cinder-quobyte-808aa66b-9747-42e7-acd3-696aa1949384" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Lock "cinder-quobyte-808aa66b-9747-42e7-acd3-696aa1949384" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91d1181-2a7a-4792-b9ca-b4973029776b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:37:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:18 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 Jul 07 10:37:18 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:19 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:19 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384 Jul 07 10:37:19 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:20 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-808aa66b-9747-42e7-acd3-696aa1949384" returned: 0 in 1.102s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Lock "cinder-quobyte-808aa66b-9747-42e7-acd3-696aa1949384" released by "delete_volume" :: held 1.977s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Acquiring lock "cinder-quobyte-b10b1926-f0eb-4185-82cd-8777523c10c0" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Lock "cinder-quobyte-b10b1926-f0eb-4185-82cd-8777523c10c0" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:20 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[66278266-bb29-46f9-b48e-4ff115c51a3d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:37:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:20 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 Jul 07 10:37:20 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:21 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0" returned: 0 in 1.141s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:21 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0 Jul 07 10:37:21 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:22 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b10b1926-f0eb-4185-82cd-8777523c10c0" returned: 0 in 0.729s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Lock "cinder-quobyte-b10b1926-f0eb-4185-82cd-8777523c10c0" released by "delete_volume" :: held 1.914s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Flow 'volume_create_manager' (776d67ca-19cb-46aa-9413-08ce72c9be6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712a902a-2a66-47a5-82ab-dfc0351ba109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712a902a-2a66-47a5-82ab-dfc0351ba109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1829550869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57e11a6-5896-4660-8feb-3fcd9617e5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32649a4c949244479eb1a605fc52f43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:23Z,use_quota=True,user_id='9c35006cdd65410ea7471899a42726c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b126eb-8cd4-4718-8cc6-327fab80b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b126eb-8cd4-4718-8cc6-327fab80b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f056c86-a6a4-47e2-8a6d-4acc8d888a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f056c86-a6a4-47e2-8a6d-4acc8d888a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57e11a6-5896-4660-8feb-3fcd9617e5ae', 'volume_name': 'volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb3ae53-06d1-41cd-945c-673aaca56d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb3ae53-06d1-41cd-945c-673aaca56d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d76614-accb-49dc-a9ce-e6e91199b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:22 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Volume a57e11a6-5896-4660-8feb-3fcd9617e5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae', 'volume_size': 1} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1829550869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57e11a6-5896-4660-8feb-3fcd9617e5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32649a4c949244479eb1a605fc52f43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:23Z,use_quota=True,user_id='9c35006cdd65410ea7471899a42726c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Creating volume a57e11a6-5896-4660-8feb-3fcd9617e5ae {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:37:22 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:22 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae 1073741824 Jul 07 10:37:22 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Created reservations ['9f68f7f3-92e8-4762-a021-13afb7de3de0'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:22 devstack cinder-volume[87208]: WARNING cinder.quota [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-202307244 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-202307244, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:37:22 devstack cinder-volume[87208]: WARNING cinder.quota [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-202307244 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-202307244, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:37:22 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Created reservations ['2eec2d2d-8956-4827-8a52-d2682ba1c0e4', '45050733-ed9c-464a-a78c-bed7d546b2a0', '214a1a87-b249-4d49-ab60-4679003f8cca', '50036ba2-5e1e-431d-8c5a-3300c8552f2a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Created reservations ['031f00af-d63b-43f9-8803-62c1c1bbfad9', '7a2b236d-8c20-498a-ae2c-7f403b209a44', '3c72ef1e-f3a2-43ef-bfca-a13867771391', '874c64d9-2aa7-45d1-a1fd-eb46328dd0f6'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:23 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:23 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:23 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:23 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:23 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae 1073741824" returned: 0 in 1.099s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:24 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae Jul 07 10:37:24 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:24 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.806s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-29cc9702-2631-4109-a7bf-98a8572ae6b5 tempest-GroupsTest-966988529 None] Delete group completed successfully. Jul 07 10:37:24 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.044s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 8 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:37:24 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae" returned: 0 in 0.901s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d76614-accb-49dc-a9ce-e6e91199b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a464b8-60ce-4f81-9e58-efe1b6422613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Volume volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae (a57e11a6-5896-4660-8feb-3fcd9617e5ae): created successfully Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a464b8-60ce-4f81-9e58-efe1b6422613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Flow 'volume_create_manager' (776d67ca-19cb-46aa-9413-08ce72c9be6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b24de57d-ef07-4010-b52d-0fe2301d3f35 tempest-ServersNegativeTestJSON-1884233504 None] Created volume successfully. Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Flow 'volume_create_manager' (5174a22e-be23-476f-9bcf-04a64dc9f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156dee04-417e-425f-a0a0-2d58350fefa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156dee04-417e-425f-a0a0-2d58350fefa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-492070477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01248df7-5810-4707-baea-f707a3fd28f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32649a4c949244479eb1a605fc52f43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:28Z,use_quota=True,user_id='9c35006cdd65410ea7471899a42726c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c7a35-e302-488e-9f45-518d67002af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c7a35-e302-488e-9f45-518d67002af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53bc85b-072c-4c7b-86dc-eb1f80229996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53bc85b-072c-4c7b-86dc-eb1f80229996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01248df7-5810-4707-baea-f707a3fd28f9', 'volume_name': 'volume-01248df7-5810-4707-baea-f707a3fd28f9', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577b424e-78b8-4161-bfd1-68ef779dc11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577b424e-78b8-4161-bfd1-68ef779dc11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf55527-7714-4654-8295-fec6f46f7719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:28 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Volume 01248df7-5810-4707-baea-f707a3fd28f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01248df7-5810-4707-baea-f707a3fd28f9', 'volume_size': 1} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-492070477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01248df7-5810-4707-baea-f707a3fd28f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32649a4c949244479eb1a605fc52f43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:28Z,use_quota=True,user_id='9c35006cdd65410ea7471899a42726c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Creating volume 01248df7-5810-4707-baea-f707a3fd28f9 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:37:28 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:37:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:28 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 1073741824 Jul 07 10:37:28 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:29 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 1073741824" returned: 0 in 1.377s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:29 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 Jul 07 10:37:29 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:30 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9" returned: 0 in 0.778s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:37:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf55527-7714-4654-8295-fec6f46f7719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01248df7-5810-4707-baea-f707a3fd28f9', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78ef7eb-dd6a-4dec-b546-7f75cb98de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:30 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Volume volume-01248df7-5810-4707-baea-f707a3fd28f9 (01248df7-5810-4707-baea-f707a3fd28f9): created successfully Jul 07 10:37:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78ef7eb-dd6a-4dec-b546-7f75cb98de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Flow 'volume_create_manager' (5174a22e-be23-476f-9bcf-04a64dc9f91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4b666d94-d5a7-48b0-8733-810aed0b1b7b tempest-ServersNegativeTestJSON-1884233504 None] Created volume successfully. Jul 07 10:37:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "cinder-01248df7-5810-4707-baea-f707a3fd28f9-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-01248df7-5810-4707-baea-f707a3fd28f9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "cinder-quobyte-01248df7-5810-4707-baea-f707a3fd28f9" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-quobyte-01248df7-5810-4707-baea-f707a3fd28f9" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cdd905-e4c2-4c63-91bd-13bc3053cdf8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:37:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:33 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 Jul 07 10:37:33 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:34 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9" returned: 0 in 1.116s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:34 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9 Jul 07 10:37:34 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:36 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-01248df7-5810-4707-baea-f707a3fd28f9" returned: 0 in 1.375s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-quobyte-01248df7-5810-4707-baea-f707a3fd28f9" released by "delete_volume" :: held 2.549s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Created reservations ['c8f720c3-baed-4b46-ba26-a169c1fcef85', '32fd7ddf-efe6-443b-89f5-ca317d6d464c', '99ae6f10-73ea-41d6-930b-2198e2fd77f0', '4b97de29-8d90-4263-b9d6-36b44750a609'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:36 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:36 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "cinder-a57e11a6-5896-4660-8feb-3fcd9617e5ae-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-a57e11a6-5896-4660-8feb-3fcd9617e5ae-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "cinder-quobyte-a57e11a6-5896-4660-8feb-3fcd9617e5ae" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-quobyte-a57e11a6-5896-4660-8feb-3fcd9617e5ae" acquired by "delete_volume" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b720555e-df73-470d-aa90-db01faaba15a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:37 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.944s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:37 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Deleted volume successfully. Jul 07 10:37:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fe942219-a016-4d85-8d87-3a3d5df20c9e tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-01248df7-5810-4707-baea-f707a3fd28f9-delete_volume" released by "delete_volume" :: held 3.857s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:37 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae Jul 07 10:37:37 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:38 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae" returned: 0 in 1.083s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:38 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae Jul 07 10:37:38 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:39 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a57e11a6-5896-4660-8feb-3fcd9617e5ae" returned: 0 in 1.039s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-quobyte-a57e11a6-5896-4660-8feb-3fcd9617e5ae" released by "delete_volume" :: held 2.201s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Created reservations ['87dd794e-bcab-4da4-9a3e-2281030fb28c', '5d862757-ef71-4c74-90ae-6266456cfd3e', 'f7772e88-d563-42ed-9318-4e7fff30d775', 'feeb5355-88c6-4b12-83e5-a502c0ee8062'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:39 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:39 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:40 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.904s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:40 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Deleted volume successfully. Jul 07 10:37:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db8bb58d-b57c-4051-99f0-87aebcc08a28 tempest-ServersNegativeTestJSON-1884233504 None] Lock "cinder-a57e11a6-5896-4660-8feb-3fcd9617e5ae-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:49 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=80,cinder:SELECT=57,cinder:DELETE=6,cinder:INSERT=18 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=67,cinder:UPDATE=71,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Flow 'volume_create_manager' (52e7c703-2280-46d7-ad4e-fbd0e755d69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33dc78a-ab81-476d-9e54-ee94a95bf481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33dc78a-ab81-476d-9e54-ee94a95bf481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-144884050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a3cbc8-7db9-45fa-bf28-af6510a09d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4493302fd4a54e198b97a71171fc9ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:51Z,use_quota=True,user_id='25f4b32f461747bcbe926639c9f7849b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15322c18-1cf0-42be-93e4-ddd8a3eee991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15322c18-1cf0-42be-93e4-ddd8a3eee991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8426a8-9b67-4d91-9a63-a2cd7698fe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8426a8-9b67-4d91-9a63-a2cd7698fe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a3cbc8-7db9-45fa-bf28-af6510a09d60', 'volume_name': 'volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271b3b9c-08b1-406d-b59b-0dd54e4423f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271b3b9c-08b1-406d-b59b-0dd54e4423f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f8539d-4146-42a0-b466-b9c9c7dc1c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:50 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Volume 71a3cbc8-7db9-45fa-bf28-af6510a09d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60', 'volume_size': 1} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-144884050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a3cbc8-7db9-45fa-bf28-af6510a09d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4493302fd4a54e198b97a71171fc9ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:51Z,use_quota=True,user_id='25f4b32f461747bcbe926639c9f7849b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Creating volume 71a3cbc8-7db9-45fa-bf28-af6510a09d60 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:37:50 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:37:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:50 devstack sudo[92033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 1073741824 Jul 07 10:37:50 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:51 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 1073741824" returned: 0 in 0.895s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:51 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 Jul 07 10:37:51 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:52 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:37:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f8539d-4146-42a0-b466-b9c9c7dc1c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1c52c0-d579-47c0-8982-85b1bb261da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:52 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Volume volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 (71a3cbc8-7db9-45fa-bf28-af6510a09d60): created successfully Jul 07 10:37:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1c52c0-d579-47c0-8982-85b1bb261da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Flow 'volume_create_manager' (52e7c703-2280-46d7-ad4e-fbd0e755d69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:52 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3a1b8c48-efc1-4785-8290-9df843304a7a tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Created volume successfully. Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Flow 'volume_create_manager' (d09fc079-12ca-42c1-aaac-c56fe1e9b86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782deef5-5e73-4328-84e3-e4d3de074235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782deef5-5e73-4328-84e3-e4d3de074235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-938322094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbbe0af-53c3-4143-95c0-2bf897d9defa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef8718e7c164a22a98c247edb5b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:54Z,use_quota=True,user_id='3d4f44eedd734405a339f04a133723b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbddb50-51b0-4cd8-a9b3-2459a470dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbddb50-51b0-4cd8-a9b3-2459a470dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5833b9d-4778-432d-ab1a-23c37a2b8eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5833b9d-4778-432d-ab1a-23c37a2b8eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbbe0af-53c3-4143-95c0-2bf897d9defa', 'volume_name': 'volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cd0c9b-2fef-41c7-ae80-da69293a4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cd0c9b-2fef-41c7-ae80-da69293a4de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7076e941-897f-49fd-ba66-b725546a5144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:53 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Volume 1dbbe0af-53c3-4143-95c0-2bf897d9defa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa', 'volume_size': 1} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-938322094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbbe0af-53c3-4143-95c0-2bf897d9defa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef8718e7c164a22a98c247edb5b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:54Z,use_quota=True,user_id='3d4f44eedd734405a339f04a133723b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Creating volume 1dbbe0af-53c3-4143-95c0-2bf897d9defa {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:37:53 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:37:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:53 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa 1073741824 Jul 07 10:37:53 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Acquiring lock "cinder-71a3cbc8-7db9-45fa-bf28-af6510a09d60-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "cinder-71a3cbc8-7db9-45fa-bf28-af6510a09d60-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Acquiring lock "cinder-quobyte-71a3cbc8-7db9-45fa-bf28-af6510a09d60" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "cinder-quobyte-71a3cbc8-7db9-45fa-bf28-af6510a09d60" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9140d4ed-f9dd-453f-bcb6-dbd51b818587]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:54 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 Jul 07 10:37:54 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:54 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa 1073741824" returned: 0 in 1.070s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:55 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa Jul 07 10:37:55 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:55 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60" returned: 0 in 0.928s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:55 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60 Jul 07 10:37:55 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:55 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7076e941-897f-49fd-ba66-b725546a5144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8782a1-034b-4bc8-b499-cedc29adbd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Volume volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa (1dbbe0af-53c3-4143-95c0-2bf897d9defa): created successfully Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8782a1-034b-4bc8-b499-cedc29adbd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Flow 'volume_create_manager' (d09fc079-12ca-42c1-aaac-c56fe1e9b86a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e9f4597c-aced-4b52-9129-d929c83a79eb tempest-AttachVolumeNegativeTest-1491468132 None] Created volume successfully. Jul 07 10:37:55 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-71a3cbc8-7db9-45fa-bf28-af6510a09d60" returned: 0 in 0.756s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "cinder-quobyte-71a3cbc8-7db9-45fa-bf28-af6510a09d60" released by "delete_volume" :: held 1.749s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:55 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Created reservations ['e1ebcd41-a12a-4fb5-813e-fb15f16ca76b', 'd9d8bf45-694f-458b-8d8e-e63e335738ac', '571bbadd-38c2-444c-90cf-f62c5c7691a1', 'fd388048-f123-4118-98f4-6e96e6757d53'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:56 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:37:56 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:56 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:37:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Deleted volume successfully. Jul 07 10:37:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb522feb-3e5b-4cce-a7c2-53803bc3b171 tempest-VolumeQuotasNegativeTestJSON-2094358889 None] Lock "cinder-71a3cbc8-7db9-45fa-bf28-af6510a09d60-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Flow 'volume_create_manager' (9f800ff1-fb0b-472c-abda-6017d4708756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b07c9d-c8ba-4996-ab8e-9c6cc48242ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b07c9d-c8ba-4996-ab8e-9c6cc48242ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1681774377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bf2213-5eaa-4b14-8dba-ff80926fd1f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0881adf6238e423ab1ba7eee1125750a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:58Z,use_quota=True,user_id='7ff46a82d62b4ddfa2af509209bf2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f53f1cf-53eb-44bb-adfe-721650440b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f53f1cf-53eb-44bb-adfe-721650440b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e16057-6650-4b65-998c-4937b64157c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e16057-6650-4b65-998c-4937b64157c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bf2213-5eaa-4b14-8dba-ff80926fd1f2', 'volume_name': 'volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364cc6ad-b110-4a0d-8d60-17f83e390fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364cc6ad-b110-4a0d-8d60-17f83e390fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35fa18d-21f0-44a2-b2e2-e32fad90efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:37:58 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Volume b4bf2213-5eaa-4b14-8dba-ff80926fd1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2', 'volume_size': 1} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1681774377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bf2213-5eaa-4b14-8dba-ff80926fd1f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0881adf6238e423ab1ba7eee1125750a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:37:58Z,use_quota=True,user_id='7ff46a82d62b4ddfa2af509209bf2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Creating volume b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:37:58 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:37:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:58 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 1073741824 Jul 07 10:37:58 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:37:59 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 07 10:37:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 1073741824" returned: 0 in 1.072s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:37:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:37:59 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 Jul 07 10:37:59 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:00 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2" returned: 0 in 0.979s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-49759202-65be-4388-9cd3-46b03b5f4cff req-3eb2ea84-1eb0-4fbc-8bd8-15fb467be4d5 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-49759202-65be-4388-9cd3-46b03b5f4cff req-3eb2ea84-1eb0-4fbc-8bd8-15fb467be4d5 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35fa18d-21f0-44a2-b2e2-e32fad90efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077a6aed-441b-48d9-8bf8-0eb55969943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb99e4-f526-4215-bfdb-11caa85d64cb]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-49759202-65be-4388-9cd3-46b03b5f4cff req-3eb2ea84-1eb0-4fbc-8bd8-15fb467be4d5 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:00 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Volume volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 (b4bf2213-5eaa-4b14-8dba-ff80926fd1f2): created successfully Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077a6aed-441b-48d9-8bf8-0eb55969943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Flow 'volume_create_manager' (9f800ff1-fb0b-472c-abda-6017d4708756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7f18fa24-cf67-44ef-8e00-68ba92f13f23 tempest-VolumesTestJSON-1321404695 None] Created volume successfully. Jul 07 10:38:00 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa Jul 07 10:38:00 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:01 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-49759202-65be-4388-9cd3-46b03b5f4cff req-3eb2ea84-1eb0-4fbc-8bd8-15fb467be4d5 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa" returned: 0 in 0.797s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-49759202-65be-4388-9cd3-46b03b5f4cff req-3eb2ea84-1eb0-4fbc-8bd8-15fb467be4d5 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-49759202-65be-4388-9cd3-46b03b5f4cff req-3eb2ea84-1eb0-4fbc-8bd8-15fb467be4d5 tempest-AttachVolumeNegativeTest-1491468132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf90abba-f08b-4695-a80d-5f9ad9b956a7', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:38:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-49759202-65be-4388-9cd3-46b03b5f4cff req-3eb2ea84-1eb0-4fbc-8bd8-15fb467be4d5 tempest-AttachVolumeNegativeTest-1491468132 None] attachment_update completed successfully. Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Flow 'volume_create_manager' (5d4aa189-ecdf-4432-b741-f82455d1a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3f94e9-c78b-498f-b313-8da27fb65169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3f94e9-c78b-498f-b313-8da27fb65169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-858995076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03ba354-bb0f-4b81-b854-bf54dec73017,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0881adf6238e423ab1ba7eee1125750a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:02Z,use_quota=True,user_id='7ff46a82d62b4ddfa2af509209bf2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b895952-d52c-4f61-8412-916ac15acec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b895952-d52c-4f61-8412-916ac15acec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae7f382-0c1d-4b68-ad59-6b9325e536ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae7f382-0c1d-4b68-ad59-6b9325e536ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03ba354-bb0f-4b81-b854-bf54dec73017', 'volume_name': 'volume-c03ba354-bb0f-4b81-b854-bf54dec73017', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a998e0-108c-4531-9a89-3b6f243d32cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a998e0-108c-4531-9a89-3b6f243d32cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65099469-3732-4fd4-ab65-f0865935956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:02 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Volume c03ba354-bb0f-4b81-b854-bf54dec73017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03ba354-bb0f-4b81-b854-bf54dec73017', 'volume_size': 1} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-858995076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03ba354-bb0f-4b81-b854-bf54dec73017,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0881adf6238e423ab1ba7eee1125750a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:02Z,use_quota=True,user_id='7ff46a82d62b4ddfa2af509209bf2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Creating volume c03ba354-bb0f-4b81-b854-bf54dec73017 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:02 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:02 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 1073741824 Jul 07 10:38:02 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:02 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 1073741824" returned: 0 in 0.966s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:03 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 Jul 07 10:38:03 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Flow 'volume_create_manager' (e07d7f70-2471-4e24-9ce9-1663d383db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d3621-7a54-48d9-9611-ef6475c86df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d3621-7a54-48d9-9611-ef6475c86df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-773407675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5f74e7-7f3e-422d-ba2a-74a37c749ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629c87e2afd145f183aeb19a9558d81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:03Z,use_quota=True,user_id='a02b4b91d29c4f8daa34766c731c4249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433dec59-80fd-444d-9c4b-3e1f92045fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433dec59-80fd-444d-9c4b-3e1f92045fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58ae20d-9095-4355-8361-1a4a25db64ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58ae20d-9095-4355-8361-1a4a25db64ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5f74e7-7f3e-422d-ba2a-74a37c749ee9', 'volume_name': 'volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53618f30-3f45-4084-8a99-193f49f6e8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53618f30-3f45-4084-8a99-193f49f6e8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1712ce-37bc-42a0-bac8-6ef16424d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:03 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Volume 7a5f74e7-7f3e-422d-ba2a-74a37c749ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9', 'volume_size': 1} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:03 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017" returned: 0 in 0.801s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-773407675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5f74e7-7f3e-422d-ba2a-74a37c749ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629c87e2afd145f183aeb19a9558d81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:03Z,use_quota=True,user_id='a02b4b91d29c4f8daa34766c731c4249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Creating volume 7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:03 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65099469-3732-4fd4-ab65-f0865935956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03ba354-bb0f-4b81-b854-bf54dec73017', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:03 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 1073741824 Jul 07 10:38:03 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554409bc-765b-4fa6-9704-66d544dbeecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:03 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Volume volume-c03ba354-bb0f-4b81-b854-bf54dec73017 (c03ba354-bb0f-4b81-b854-bf54dec73017): created successfully Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554409bc-765b-4fa6-9704-66d544dbeecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Flow 'volume_create_manager' (5d4aa189-ecdf-4432-b741-f82455d1a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-54535826-22d1-4000-9a36-f7e6a47b699b tempest-VolumesTestJSON-1321404695 None] Created volume successfully. Jul 07 10:38:04 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 1073741824" returned: 0 in 1.074s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:05 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 Jul 07 10:38:05 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Flow 'volume_create_manager' (f1110830-df85-4f46-8638-ac06600d3c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290ee4d8-9685-4fb4-9fd5-d93bfd79348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:05 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" returned: 0 in 0.979s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290ee4d8-9685-4fb4-9fd5-d93bfd79348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1666578571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b931aedc-c886-4264-9f7a-7c67ad5e166e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0881adf6238e423ab1ba7eee1125750a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:06Z,use_quota=True,user_id='7ff46a82d62b4ddfa2af509209bf2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48911636-141c-42e6-9d7b-1acfc0b1c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48911636-141c-42e6-9d7b-1acfc0b1c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccc55eb-c2d8-4a8f-98da-161deb4ab0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccc55eb-c2d8-4a8f-98da-161deb4ab0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b931aedc-c886-4264-9f7a-7c67ad5e166e', 'volume_name': 'volume-b931aedc-c886-4264-9f7a-7c67ad5e166e', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5ec740-c570-476a-ad9c-33b3f61865d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5ec740-c570-476a-ad9c-33b3f61865d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d74ef0-0a91-442e-96e1-78fe9a0d1c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:06 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Volume b931aedc-c886-4264-9f7a-7c67ad5e166e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b931aedc-c886-4264-9f7a-7c67ad5e166e', 'volume_size': 1} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1666578571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b931aedc-c886-4264-9f7a-7c67ad5e166e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0881adf6238e423ab1ba7eee1125750a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:06Z,use_quota=True,user_id='7ff46a82d62b4ddfa2af509209bf2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Creating volume b931aedc-c886-4264-9f7a-7c67ad5e166e {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:06 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1712ce-37bc-42a0-bac8-6ef16424d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:06 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e 1073741824 Jul 07 10:38:06 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f295cc-be1f-4e46-a2cd-2ff0a3e57496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:06 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Volume volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 (7a5f74e7-7f3e-422d-ba2a-74a37c749ee9): created successfully Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f295cc-be1f-4e46-a2cd-2ff0a3e57496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Flow 'volume_create_manager' (e07d7f70-2471-4e24-9ce9-1663d383db9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3e510957-53fc-4c26-9e29-a4ac4da02f16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Created volume successfully. Jul 07 10:38:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:07 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e 1073741824" returned: 0 in 1.040s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:07 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e Jul 07 10:38:07 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:07 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e" returned: 0 in 0.690s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.946s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Creating offline snapshot 8bed5ad9-9328-4cf2-88c9-44e8ca9236dc of volume 7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d74ef0-0a91-442e-96e1-78fe9a0d1c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b931aedc-c886-4264-9f7a-7c67ad5e166e', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53e9e79-77e5-45d7-ae97-3e10402bca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc95b9e-b5d2-478f-9929-c55d71c722d0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:07 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Volume volume-b931aedc-c886-4264-9f7a-7c67ad5e166e (b931aedc-c886-4264-9f7a-7c67ad5e166e): created successfully Jul 07 10:38:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53e9e79-77e5-45d7-ae97-3e10402bca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Flow 'volume_create_manager' (f1110830-df85-4f46-8638-ac06600d3c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:08 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9d4bad73-daf6-42d5-9b60-f396bd164e57 tempest-VolumesTestJSON-1321404695 None] Created volume successfully. Jul 07 10:38:08 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 Jul 07 10:38:08 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:08 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" returned: 0 in 0.885s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:08 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc 1G Jul 07 10:38:08 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-7e596720-5781-4191-810c-16d89be4e8ee req-0406b2e0-996a-47ae-a4fd-7615ce86cf1a tempest-AttachVolumeNegativeTest-1491468132 None] Terminate volume connection completed successfully. Jul 07 10:38:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-7e596720-5781-4191-810c-16d89be4e8ee req-0406b2e0-996a-47ae-a4fd-7615ce86cf1a tempest-AttachVolumeNegativeTest-1491468132 None] Deleting attachment cf90abba-f08b-4695-a80d-5f9ad9b956a7. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:38:10 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc 1G" returned: 0 in 1.214s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:10 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc Jul 07 10:38:10 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "cinder-b931aedc-c886-4264-9f7a-7c67ad5e166e-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-b931aedc-c886-4264-9f7a-7c67ad5e166e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "cinder-quobyte-b931aedc-c886-4264-9f7a-7c67ad5e166e" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-quobyte-b931aedc-c886-4264-9f7a-7c67ad5e166e" acquired by "delete_volume" :: waited 0.053s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e4771-fda4-4271-bb5b-aa72daefb549]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:10 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e Jul 07 10:38:10 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:10 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" returned: 0 in 0.915s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:10 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc is being set with open permissions: ugo+rw Jul 07 10:38:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:11 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc Jul 07 10:38:11 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:11 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e" returned: 0 in 0.933s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:11 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e Jul 07 10:38:11 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:11 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" returned: 0 in 0.782s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:11 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.info Jul 07 10:38:11 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:12 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b931aedc-c886-4264-9f7a-7c67ad5e166e" returned: 0 in 0.958s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-quobyte-b931aedc-c886-4264-9f7a-7c67ad5e166e" released by "delete_volume" :: held 1.940s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Created reservations ['beab85b2-c0ab-4229-adeb-0bcba55415a3', '6aa36841-ddd6-4c6f-aef5-dbac02f6db17', 'd057626c-f538-46a2-a6a2-68dce990a75c', '5f1ab06d-00fc-4b68-aba2-c8754bc1a053'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:12 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.info" returned: 0 in 0.813s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:12 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.info is being set with open permissions: ugo+rw Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:12 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:12 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:12 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.info Jul 07 10:38:12 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "cinder-c03ba354-bb0f-4b81-b854-bf54dec73017-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-c03ba354-bb0f-4b81-b854-bf54dec73017-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "cinder-quobyte-c03ba354-bb0f-4b81-b854-bf54dec73017" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-quobyte-c03ba354-bb0f-4b81-b854-bf54dec73017" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5670459-55c4-4b5b-b85f-62396a17845a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:13 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 Jul 07 10:38:13 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:13 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.974s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:13 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:13 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Deleted volume successfully. Jul 07 10:38:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.info" returned: 0 in 0.951s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.684s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b6a38ddd-9b57-40d9-b384-24a86e0438d9 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-b931aedc-c886-4264-9f7a-7c67ad5e166e-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c2e7ce6c-1f59-4146-9c8c-5d92d2c4b65a tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Create snapshot completed successfully Jul 07 10:38:14 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017" returned: 0 in 1.377s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:14 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017 Jul 07 10:38:14 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "cinder-8bed5ad9-9328-4cf2-88c9-44e8ca9236dc-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-8bed5ad9-9328-4cf2-88c9-44e8ca9236dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "cinder-quobyte-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-quobyte-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "cinder-quobyte-8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:15 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c03ba354-bb0f-4b81-b854-bf54dec73017" returned: 0 in 0.915s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-quobyte-c03ba354-bb0f-4b81-b854-bf54dec73017" released by "delete_volume" :: held 2.354s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-quobyte-8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Deleting offline snapshot 8bed5ad9-9328-4cf2-88c9-44e8ca9236dc of volume 7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] snapshot_file for this snap is: volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[81888459-87c2-4f7e-bdfa-fbc9783a73d7]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Created reservations ['bfc4c78f-d7b6-4d12-8d94-deaf38eb6a12', '3ee32cb9-73fe-41be-bedb-1227e2612057', 'ae522a9e-93d6-4b86-a6e8-4ce5b469d362', 'cc952314-cf5f-42f2-978c-cc2e5b411a15'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:15 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc Jul 07 10:38:15 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:15 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:15 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:16 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.811s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Deleted volume successfully. Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-218423f0-a24c-4068-9881-799ef79ae2b6 tempest-VolumesTestJSON-1321404695 None] Lock "cinder-c03ba354-bb0f-4b81-b854-bf54dec73017-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:16 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" returned: 0 in 1.072s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d682263a-6ffe-4021-a0af-949d7f2a2217]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Acquiring lock "cinder-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Lock "cinder-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Acquiring lock "cinder-quobyte-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Lock "cinder-quobyte-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c9e0c-f5a5-4974-a3e1-3e5cd849e256]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:16 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 Jul 07 10:38:16 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:16 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 Jul 07 10:38:16 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:17 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" returned: 0 in 0.902s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:17 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc Jul 07 10:38:17 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:17 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2" returned: 0 in 0.843s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:17 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2 Jul 07 10:38:17 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:18 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" returned: 0 in 0.800s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:18 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc Jul 07 10:38:18 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:18 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2" returned: 0 in 0.762s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Lock "cinder-quobyte-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2" released by "delete_volume" :: held 1.653s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Created reservations ['65054bb4-bc9b-46e9-8d62-ac958e15b113', '9a8502c7-4e9a-4218-a4e5-6ad40c189119', 'f6a307df-0cb3-45ce-a2bb-2f7dbadebe25', 'ca87f228-da11-42c1-bb15-d888fb6deb6b'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:18 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:18 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:18 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9.8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" returned: 0 in 0.781s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-quobyte-8bed5ad9-9328-4cf2-88c9-44e8ca9236dc" released by "_delete_snapshot" :: held 3.720s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-quobyte-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" released by "delete_snapshot" :: held 3.798s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:19 devstack cinder-volume[87208]: WARNING cinder.quota [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Created reservations ['e091444a-fbcf-4f03-8db6-5d9fbf4fe938', '8cc04bb3-8f56-4bb9-9238-a38b7ffa167d', 'd9b44236-0c34-4980-bc93-1e3731e2d505', '906cf75a-1f99-4f99-a4ec-20a2114ee18e'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Delete snapshot completed successfully. Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a190b122-4c56-499c-b392-90bb4d59d8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-8bed5ad9-9328-4cf2-88c9-44e8ca9236dc-delete_snapshot" released by "delete_snapshot" :: held 4.017s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:19 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.946s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Deleted volume successfully. Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98990128-5078-403d-a555-9bbb7f35436c tempest-VolumesTestJSON-1321404695 None] Lock "cinder-b4bf2213-5eaa-4b14-8dba-ff80926fd1f2-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "cinder-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "cinder-quobyte-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-quobyte-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d302b9-b4b6-4178-9528-6ed7e081c013]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:19 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 Jul 07 10:38:19 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:20 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" returned: 0 in 0.858s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:20 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9 Jul 07 10:38:20 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:21 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" returned: 0 in 0.743s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-quobyte-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9" released by "delete_volume" :: held 1.664s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Created reservations ['caa25f57-42fc-4dd0-b7ce-ad82fdb37219', 'b43e20c8-d889-46c6-8e5e-edef6ad20dd6', '3ec6de87-8149-45ff-ad48-9399c8f7d3cb', '28293cbf-d161-484a-81e4-5c2f5485b1fe'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:21 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:21 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:22 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.843s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:22 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:22 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Deleted volume successfully. Jul 07 10:38:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7a75d7bf-f978-4746-a696-15d00a0b7693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1709201439 None] Lock "cinder-7a5f74e7-7f3e-422d-ba2a-74a37c749ee9-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bb28a5c3-50ff-4ab7-866e-6e66c287dfdb tempest-GroupSnapshotsV319Test-251201806 None] Group tempest-GroupSnapshotsV319Test-Group-1724942701: creating Jul 07 10:38:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:38:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:23 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:23 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bb28a5c3-50ff-4ab7-866e-6e66c287dfdb tempest-GroupSnapshotsV319Test-251201806 None] Group tempest-GroupSnapshotsV319Test-Group-1724942701: created successfully Jul 07 10:38:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bb28a5c3-50ff-4ab7-866e-6e66c287dfdb tempest-GroupSnapshotsV319Test-251201806 None] Create group completed successfully. Jul 07 10:38:24 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.731s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:38:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 8 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:38:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Flow 'volume_create_manager' (0390a30c-df38-4f25-863d-76c4097a92d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ae39f1-e919-4ed4-91b8-f9e6f15c1238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ae39f1-e919-4ed4-91b8-f9e6f15c1238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1559769922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a283449-b137-4584-a8f4-a7b80cc43be2,host='devstack@QuobyteHD#QuobyteHD',id=b7b4f94c-20a5-458d-8cd6-f1b258576508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454ab1d6da41471b81953b7cc6731c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:25Z,use_quota=True,user_id='c0d899c433654a70b1963810449975e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d27c8d52-5149-4a3d-b688-2568d03ffc4b),volume_type_id=d27c8d52-5149-4a3d-b688-2568d03ffc4b)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98109041-3fb3-49f2-a92c-e73631737360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98109041-3fb3-49f2-a92c-e73631737360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1605908b-787a-45b1-8b1b-2bb2e31b1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1605908b-787a-45b1-8b1b-2bb2e31b1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b4f94c-20a5-458d-8cd6-f1b258576508', 'volume_name': 'volume-b7b4f94c-20a5-458d-8cd6-f1b258576508', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d382959-46bf-4820-801c-cfdd36d7ace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d382959-46bf-4820-801c-cfdd36d7ace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d11dac-80e9-4e96-9fd2-aa3055d0086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:25 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Volume b7b4f94c-20a5-458d-8cd6-f1b258576508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b4f94c-20a5-458d-8cd6-f1b258576508', 'volume_size': 1} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a283449-b137-4584-a8f4-a7b80cc43be2,created_at=2026-07-07T08:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1559769922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a283449-b137-4584-a8f4-a7b80cc43be2,host='devstack@QuobyteHD#QuobyteHD',id=b7b4f94c-20a5-458d-8cd6-f1b258576508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454ab1d6da41471b81953b7cc6731c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:25Z,use_quota=True,user_id='c0d899c433654a70b1963810449975e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d27c8d52-5149-4a3d-b688-2568d03ffc4b),volume_type_id=d27c8d52-5149-4a3d-b688-2568d03ffc4b)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Creating volume b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:25 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:25 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 1073741824 Jul 07 10:38:25 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:26 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 1073741824" returned: 0 in 0.823s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:26 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 Jul 07 10:38:26 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:27 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d11dac-80e9-4e96-9fd2-aa3055d0086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b4f94c-20a5-458d-8cd6-f1b258576508', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc5f080-72f1-4ef9-b476-339012cae930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:27 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Volume volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 (b7b4f94c-20a5-458d-8cd6-f1b258576508): created successfully Jul 07 10:38:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc5f080-72f1-4ef9-b476-339012cae930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Flow 'volume_create_manager' (0390a30c-df38-4f25-863d-76c4097a92d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8c995155-185b-4989-b38e-2b542770355c tempest-GroupSnapshotsV319Test-251201806 None] Created volume successfully. Jul 07 10:38:28 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] GroupSnapshot 6fc131aa-ca0e-41e0-8e1a-c4f901cccc7f: creating. Jul 07 10:38:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Group snapshot 6fc131aa-ca0e-41e0-8e1a-c4f901cccc7f: creating. {{(pid=87208) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 10:38:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Creating offline snapshot 081e7bad-60c5-4777-82d4-5c6771d9598b of volume b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:38:28 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b95da4a-97bc-403b-bce2-922d116424b9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:28 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 Jul 07 10:38:28 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:29 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508" returned: 0 in 0.818s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:29 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b 1G Jul 07 10:38:29 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:29 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b 1G" returned: 0 in 0.914s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:29 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b Jul 07 10:38:29 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:30 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b" returned: 0 in 1.030s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:30 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:38:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:31 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b Jul 07 10:38:31 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Flow 'volume_create_manager' (397ee4a1-5136-45ac-befb-9b0da3a81036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39798e72-e708-4fa3-923a-a910e1d1f621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39798e72-e708-4fa3-923a-a910e1d1f621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1102898868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d82af9-a518-4f88-8238-5058e54026ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43de7362d4634a45bda147ee65642cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:31Z,use_quota=True,user_id='603a2b5f12a440808754ef5fccab2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b61bfe-9dd6-42a9-a66a-66a050563132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b61bfe-9dd6-42a9-a66a-66a050563132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc84dc69-4541-456f-95ca-dfc84fc2e975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc84dc69-4541-456f-95ca-dfc84fc2e975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d82af9-a518-4f88-8238-5058e54026ef', 'volume_name': 'volume-b2d82af9-a518-4f88-8238-5058e54026ef', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ffbfa1-b589-4fa8-b9e5-e1fb9f509c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ffbfa1-b589-4fa8-b9e5-e1fb9f509c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b342edfb-5273-4706-a91d-5f3817f7084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:31 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Volume b2d82af9-a518-4f88-8238-5058e54026ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d82af9-a518-4f88-8238-5058e54026ef', 'volume_size': 1} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:31 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b" returned: 0 in 0.985s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:32 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.info Jul 07 10:38:32 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:32 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.info" returned: 0 in 0.698s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:32 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:38:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:32 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.info Jul 07 10:38:32 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:33 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.info" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.220s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1102898868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d82af9-a518-4f88-8238-5058e54026ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43de7362d4634a45bda147ee65642cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:31Z,use_quota=True,user_id='603a2b5f12a440808754ef5fccab2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Creating volume b2d82af9-a518-4f88-8238-5058e54026ef {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:33 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:33 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef 1073741824 Jul 07 10:38:33 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9d65e811-39e5-4921-892f-65b388165341 tempest-GroupSnapshotsV319Test-251201806 None] group_snapshot 6fc131aa-ca0e-41e0-8e1a-c4f901cccc7f: created successfully Jul 07 10:38:34 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef 1073741824" returned: 0 in 0.931s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:34 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef Jul 07 10:38:34 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:35 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] group_snapshot 6fc131aa-ca0e-41e0-8e1a-c4f901cccc7f: deleting Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] group_snapshot 6fc131aa-ca0e-41e0-8e1a-c4f901cccc7f: deleting {{(pid=87208) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Acquiring lock "cinder-quobyte-b7b4f94c-20a5-458d-8cd6-f1b258576508" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Lock "cinder-quobyte-b7b4f94c-20a5-458d-8cd6-f1b258576508" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:35 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Acquiring lock "cinder-quobyte-081e7bad-60c5-4777-82d4-5c6771d9598b" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef" returned: 0 in 0.792s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Lock "cinder-quobyte-081e7bad-60c5-4777-82d4-5c6771d9598b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Deleting offline snapshot 081e7bad-60c5-4777-82d4-5c6771d9598b of volume b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] snapshot_file for this snap is: volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b342edfb-5273-4706-a91d-5f3817f7084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d82af9-a518-4f88-8238-5058e54026ef', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c36a41-03a5-4b19-be7b-5d4e0cb76415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bcb65d-6c57-402a-8bc8-07e8d67b6a95]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:35 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Volume volume-b2d82af9-a518-4f88-8238-5058e54026ef (b2d82af9-a518-4f88-8238-5058e54026ef): created successfully Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c36a41-03a5-4b19-be7b-5d4e0cb76415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Flow 'volume_create_manager' (397ee4a1-5136-45ac-befb-9b0da3a81036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:35 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-82c56b13-4c29-42cb-b46c-5d1ac7a5c466 tempest-AttachVolumeTestJSON-1667183289 None] Created volume successfully. Jul 07 10:38:35 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b Jul 07 10:38:35 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:36 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b" returned: 0 in 1.115s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b4f94c-20a5-458d-8cd6-f1b258576508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:38:36 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4e0892-b2a9-438a-bf25-9e72f30f7374]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:36 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 Jul 07 10:38:36 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:37 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508" returned: 0 in 0.841s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:37 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b Jul 07 10:38:37 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:38 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b" returned: 0 in 1.070s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:38 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b Jul 07 10:38:38 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:39 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508.081e7bad-60c5-4777-82d4-5c6771d9598b" returned: 0 in 1.068s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Lock "cinder-quobyte-081e7bad-60c5-4777-82d4-5c6771d9598b" released by "_delete_snapshot" :: held 4.275s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Lock "cinder-quobyte-b7b4f94c-20a5-458d-8cd6-f1b258576508" released by "delete_snapshot" :: held 4.328s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-952cf634-e3ca-4723-92c6-d7a2b4d1aef2 req-01c7619e-e690-4e0d-b01b-af215521428d tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-952cf634-e3ca-4723-92c6-d7a2b4d1aef2 req-01c7619e-e690-4e0d-b01b-af215521428d tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff427d-2f2b-420c-b196-8664357bcea1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-952cf634-e3ca-4723-92c6-d7a2b4d1aef2 req-01c7619e-e690-4e0d-b01b-af215521428d tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:39 devstack cinder-volume[87208]: WARNING cinder.quota [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1238330071 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1238330071, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:38:39 devstack cinder-volume[87208]: WARNING cinder.quota [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1238330071 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1238330071, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:38:39 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] Created reservations ['0826c1ef-237a-4718-a272-0d8637b4897f', 'bbbb3830-695e-4990-99f1-20a6aace7b28', '8ba6352e-2dbf-4245-901f-39a5288431ec', 'a5ce3a76-7147-47c6-940f-ac935950c89b'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:39 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef Jul 07 10:38:39 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2593f4c7-39ed-4f4d-8315-8389d5270b6d tempest-GroupSnapshotsV319Test-251201806 None] group_snapshot 6fc131aa-ca0e-41e0-8e1a-c4f901cccc7f: deleted successfully Jul 07 10:38:40 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-952cf634-e3ca-4723-92c6-d7a2b4d1aef2 req-01c7619e-e690-4e0d-b01b-af215521428d tempest-AttachVolumeTestJSON-1667183289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef" returned: 0 in 0.903s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-952cf634-e3ca-4723-92c6-d7a2b4d1aef2 req-01c7619e-e690-4e0d-b01b-af215521428d tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-952cf634-e3ca-4723-92c6-d7a2b4d1aef2 req-01c7619e-e690-4e0d-b01b-af215521428d tempest-AttachVolumeTestJSON-1667183289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-b2d82af9-a518-4f88-8238-5058e54026ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ee9dc32-f2d8-4b8d-813b-62129b98c6c0', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:38:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-952cf634-e3ca-4723-92c6-d7a2b4d1aef2 req-01c7619e-e690-4e0d-b01b-af215521428d tempest-AttachVolumeTestJSON-1667183289 None] attachment_update completed successfully. Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Flow 'volume_create_manager' (8906096d-67ae-4bd2-b958-7424287074ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682b3f69-3dbc-46c4-8095-d3778dacd013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682b3f69-3dbc-46c4-8095-d3778dacd013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-345269214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a6367de9274337ba7fd26222c19e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:41Z,use_quota=True,user_id='18b50b8cb4ef43a3b7b61cdfd7ff0150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f27d51-e39d-4965-ab69-0cfa061dfeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f27d51-e39d-4965-ab69-0cfa061dfeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4def5267-8a9a-40a9-b08d-3501e52d7a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4def5267-8a9a-40a9-b08d-3501e52d7a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff', 'volume_name': 'volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a9709c-deb2-45e5-832a-c3ea9a32e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a9709c-deb2-45e5-832a-c3ea9a32e876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7025e4f-a959-47f6-a7bd-01ec6cde8a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Volume bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff', 'volume_size': 1} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-345269214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a6367de9274337ba7fd26222c19e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:41Z,use_quota=True,user_id='18b50b8cb4ef43a3b7b61cdfd7ff0150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Creating volume bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:41 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:41 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff 1073741824 Jul 07 10:38:41 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Acquiring lock "cinder-quobyte-b7b4f94c-20a5-458d-8cd6-f1b258576508" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Lock "cinder-quobyte-b7b4f94c-20a5-458d-8cd6-f1b258576508" acquired by "delete_volume" :: waited 0.056s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[72571b4b-ccfc-4910-a441-a65f5a72524e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:41 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 Jul 07 10:38:41 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:42 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff 1073741824" returned: 0 in 1.267s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:42 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508" returned: 0 in 1.138s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:42 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508 Jul 07 10:38:42 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:42 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff Jul 07 10:38:42 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:43 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b7b4f94c-20a5-458d-8cd6-f1b258576508" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Lock "cinder-quobyte-b7b4f94c-20a5-458d-8cd6-f1b258576508" released by "delete_volume" :: held 1.978s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:43 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7025e4f-a959-47f6-a7bd-01ec6cde8a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58307fd8-5fd3-4725-9151-b534b7cb2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Volume volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff (bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff): created successfully Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58307fd8-5fd3-4725-9151-b534b7cb2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Flow 'volume_create_manager' (8906096d-67ae-4bd2-b958-7424287074ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8475c812-f6d9-4d9c-9d90-6de6a6cbc4e1 tempest-VolumesListAdminTestJSON-2093788262 None] Created volume successfully. Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Created reservations ['1fcff61d-7a67-4552-b46f-a386bb8be1d0'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:43 devstack cinder-volume[87208]: WARNING cinder.quota [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1238330071 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1238330071, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Created reservations ['c69f5498-daa8-4553-a9f2-21931a31253a', 'c181eb12-0016-43e6-9cac-d987b08dca73', 'b0d536be-a632-480c-821a-19e15f1bd042', '63a8add8-acc2-48d8-bd85-580da9aa6680'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:43 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:43 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:44 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.112s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:44 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:44 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-151f11ae-58c4-4b55-bd9d-2f47aa262ea8 tempest-GroupSnapshotsV319Test-251201806 None] Delete group completed successfully. Jul 07 10:38:44 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Flow 'volume_create_manager' (347c48a2-6c29-4309-82a4-80dfcf285706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42567ba4-11f7-4a74-b837-2b2549b07fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42567ba4-11f7-4a74-b837-2b2549b07fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-730178266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df7a5b-26e7-4e5b-b55c-9ba63150321c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a6367de9274337ba7fd26222c19e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:45Z,use_quota=True,user_id='18b50b8cb4ef43a3b7b61cdfd7ff0150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c482885-f990-4907-8cc1-172443eb81d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c482885-f990-4907-8cc1-172443eb81d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762f89ab-ab8a-4e9b-a8ec-4dd250b440fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762f89ab-ab8a-4e9b-a8ec-4dd250b440fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6df7a5b-26e7-4e5b-b55c-9ba63150321c', 'volume_name': 'volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e76c25a-96a3-4554-9733-ef2ea4f8e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e76c25a-96a3-4554-9733-ef2ea4f8e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a22ae-682b-4cac-b50a-c71830bd467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:45 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Volume e6df7a5b-26e7-4e5b-b55c-9ba63150321c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c', 'volume_size': 1} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-730178266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df7a5b-26e7-4e5b-b55c-9ba63150321c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a6367de9274337ba7fd26222c19e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:45Z,use_quota=True,user_id='18b50b8cb4ef43a3b7b61cdfd7ff0150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Creating volume e6df7a5b-26e7-4e5b-b55c-9ba63150321c {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:45 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:45 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c 1073741824 Jul 07 10:38:45 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:46 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c 1073741824" returned: 0 in 1.145s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:46 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c Jul 07 10:38:46 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:47 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c" returned: 0 in 0.748s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a22ae-682b-4cac-b50a-c71830bd467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa69c8dc-1ed6-44f6-ba8a-0544f57cceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Volume volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c (e6df7a5b-26e7-4e5b-b55c-9ba63150321c): created successfully Jul 07 10:38:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa69c8dc-1ed6-44f6-ba8a-0544f57cceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Flow 'volume_create_manager' (347c48a2-6c29-4309-82a4-80dfcf285706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f48e4a1f-c802-4336-aac6-285b7f660b31 tempest-VolumesListAdminTestJSON-2093788262 None] Created volume successfully. Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Flow 'volume_create_manager' (6a731784-2aef-4442-b4a8-6465c1ada5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af4f9e-337e-4594-b204-bd2654943212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af4f9e-337e-4594-b204-bd2654943212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-398560125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bcd1f3-f5d7-4d61-ae32-c6d946384664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a6367de9274337ba7fd26222c19e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:49Z,use_quota=True,user_id='18b50b8cb4ef43a3b7b61cdfd7ff0150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63fc671-e864-4e7d-b815-aaef381e8f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63fc671-e864-4e7d-b815-aaef381e8f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16085d48-24bf-4758-9be9-b809d75420df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16085d48-24bf-4758-9be9-b809d75420df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bcd1f3-f5d7-4d61-ae32-c6d946384664', 'volume_name': 'volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93789426-6525-4a52-9102-4b1fba7b0a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93789426-6525-4a52-9102-4b1fba7b0a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088a2570-1e0a-4041-8f89-bc1023d77784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Volume f4bcd1f3-f5d7-4d61-ae32-c6d946384664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664', 'volume_size': 1} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-398560125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bcd1f3-f5d7-4d61-ae32-c6d946384664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a6367de9274337ba7fd26222c19e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:49Z,use_quota=True,user_id='18b50b8cb4ef43a3b7b61cdfd7ff0150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Creating volume f4bcd1f3-f5d7-4d61-ae32-c6d946384664 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:48 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:48 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 1073741824 Jul 07 10:38:48 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:50 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 1073741824" returned: 0 in 1.123s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=96,cinder:SELECT=95,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:50 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 Jul 07 10:38:50 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:50 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664" returned: 0 in 0.805s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=87,cinder:UPDATE=109,cinder:INSERT=22,cinder:DELETE=10 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088a2570-1e0a-4041-8f89-bc1023d77784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ff7ae-2ca4-49d3-b7c8-af13f94f1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:50 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Volume volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 (f4bcd1f3-f5d7-4d61-ae32-c6d946384664): created successfully Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ff7ae-2ca4-49d3-b7c8-af13f94f1edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Flow 'volume_create_manager' (6a731784-2aef-4442-b4a8-6465c1ada5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9c141a14-b449-46f8-8f63-da901e9c4401 tempest-VolumesListAdminTestJSON-2093788262 None] Created volume successfully. Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Flow 'volume_create_manager' (111adb2a-e80c-4254-a5d6-abc17cd35a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344b010e-fdab-401b-8311-f73368edf551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344b010e-fdab-401b-8311-f73368edf551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84acc9e952b4c8bbbfa62aeab817ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:53Z,use_quota=True,user_id='db147595577e4e51ade7ce3582b7877a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786d980b-e3c8-479b-80a0-3a55ae3d793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786d980b-e3c8-479b-80a0-3a55ae3d793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc1180d-056c-457c-98a3-010f8f856824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc1180d-056c-457c-98a3-010f8f856824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53', 'volume_name': 'volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09e1bb2-5bc7-40f4-9430-31cd7bd3934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09e1bb2-5bc7-40f4-9430-31cd7bd3934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e59ff6-d75c-476d-b7b4-a10ba39757b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:52 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Volume e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53', 'volume_size': 1} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84acc9e952b4c8bbbfa62aeab817ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:53Z,use_quota=True,user_id='db147595577e4e51ade7ce3582b7877a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Creating volume e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:52 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:52 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 1073741824 Jul 07 10:38:52 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:53 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 1073741824" returned: 0 in 0.864s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:53 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 Jul 07 10:38:53 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:54 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53" returned: 0 in 0.649s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:38:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e59ff6-d75c-476d-b7b4-a10ba39757b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e2335f-c854-4890-a6c7-a7bf94d33531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:54 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Volume volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 (e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53): created successfully Jul 07 10:38:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e2335f-c854-4890-a6c7-a7bf94d33531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Flow 'volume_create_manager' (111adb2a-e80c-4254-a5d6-abc17cd35a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e3038b33-f814-40d9-bdd6-a959b9f41497 tempest-VolumesListAdminTestJSON-1273334793 None] Created volume successfully. Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Acquiring lock "cinder-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Lock "cinder-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Acquiring lock "cinder-quobyte-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Lock "cinder-quobyte-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cadb6be-3d39-4166-8602-749f614b6754]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "cinder-f4bcd1f3-f5d7-4d61-ae32-c6d946384664-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:55 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-f4bcd1f3-f5d7-4d61-ae32-c6d946384664-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:55 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "cinder-quobyte-f4bcd1f3-f5d7-4d61-ae32-c6d946384664" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-quobyte-f4bcd1f3-f5d7-4d61-ae32-c6d946384664" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e77cc4-5f27-40ba-916d-187e44ea5d1e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:55 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 Jul 07 10:38:55 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:56 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53" returned: 0 in 0.904s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:56 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53 Jul 07 10:38:56 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c38b1885-07e4-4a2e-b6b2-f30b46a627cd tempest-GroupsV314Test-615241368 None] Group tempest-GroupsV314Test-Group-481673679: creating Jul 07 10:38:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c38b1885-07e4-4a2e-b6b2-f30b46a627cd tempest-GroupsV314Test-615241368 None] Group tempest-GroupsV314Test-Group-481673679: created successfully Jul 07 10:38:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c38b1885-07e4-4a2e-b6b2-f30b46a627cd tempest-GroupsV314Test-615241368 None] Create group completed successfully. Jul 07 10:38:56 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664" returned: 0 in 0.889s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:56 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664 Jul 07 10:38:56 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:56 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Lock "cinder-quobyte-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53" released by "delete_volume" :: held 1.655s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Created reservations ['a60e7a1a-480b-4b8f-9600-82e4b115a1d9', '4f919fab-2540-4ef9-bc54-395900a22c5a', 'b21d7cd6-7696-4eab-9c3a-7af9d5790d36', '40e5d5a0-ef9e-4841-aebe-80bdbc90fcdd'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:56 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:56 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:57 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f4bcd1f3-f5d7-4d61-ae32-c6d946384664" returned: 0 in 0.673s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-quobyte-f4bcd1f3-f5d7-4d61-ae32-c6d946384664" released by "delete_volume" :: held 1.641s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Created reservations ['b604d959-29ca-4cfa-b3d8-69bb5b611b56', '391121be-cccb-487d-a027-8eca51d55e4a', '98df7597-c95a-4f7f-85a7-7278787b873b', '93a73ac3-56e8-445a-bcaa-3a664fe48224'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:57 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:38:57 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "cinder-e6df7a5b-26e7-4e5b-b55c-9ba63150321c-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-e6df7a5b-26e7-4e5b-b55c-9ba63150321c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "cinder-quobyte-e6df7a5b-26e7-4e5b-b55c-9ba63150321c" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-quobyte-e6df7a5b-26e7-4e5b-b55c-9ba63150321c" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[292aacfb-0e50-4e8d-98f9-fb9b93af9e8c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:38:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:38:58 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Flow 'volume_create_manager' (a2a272aa-d9ef-42c9-93b1-984bc240d7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34b4b7c-c190-4f44-b665-c327dbd18dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.215s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Deleted volume successfully. Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34b4b7c-c190-4f44-b665-c327dbd18dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294387001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06bf0b79-9003-494c-a5a6-f2d5e3fc1328,host='devstack@QuobyteHD#QuobyteHD',id=9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39eab1e06c8476997042f6a762da7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:58Z,use_quota=True,user_id='467fa3f063a14062b0202dbdc19c53c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bc7a7a1-43b2-4482-bd9b-8ef522ace9e2),volume_type_id=8bc7a7a1-43b2-4482-bd9b-8ef522ace9e2)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:58 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c Jul 07 10:38:58 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031a205e-1d52-48bb-b49c-70b7fd2fa96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031a205e-1d52-48bb-b49c-70b7fd2fa96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6c8efc-1b16-4625-9cd7-aa076a7834d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6c8efc-1b16-4625-9cd7-aa076a7834d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc', 'volume_name': 'volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0bcd34-6dd7-4c42-a135-1aaf764b7c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0bcd34-6dd7-4c42-a135-1aaf764b7c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39566eec-13e1-4930-9eb7-52d9b3895981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:38:58 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Volume 9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc', 'volume_size': 1} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06bf0b79-9003-494c-a5a6-f2d5e3fc1328,created_at=2026-07-07T08:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294387001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06bf0b79-9003-494c-a5a6-f2d5e3fc1328,host='devstack@QuobyteHD#QuobyteHD',id=9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39eab1e06c8476997042f6a762da7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:38:58Z,use_quota=True,user_id='467fa3f063a14062b0202dbdc19c53c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bc7a7a1-43b2-4482-bd9b-8ef522ace9e2),volume_type_id=8bc7a7a1-43b2-4482-bd9b-8ef522ace9e2)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Creating volume 9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:38:58 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:58 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc 1073741824 Jul 07 10:38:58 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-39b8a2ee-7f7d-47a3-9776-c9f82960b45c tempest-VolumesListAdminTestJSON-1273334793 None] Lock "cinder-e8ac9f59-da1f-4cd9-aba6-4a06dde8bf53-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:58 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.552s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:38:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Deleted volume successfully. Jul 07 10:38:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-cacd30c1-babc-4f17-bc5b-715a97c545e3 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-f4bcd1f3-f5d7-4d61-ae32-c6d946384664-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:38:59 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 07 10:38:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c" returned: 0 in 1.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:38:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:38:59 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c Jul 07 10:38:59 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:00 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc 1073741824" returned: 0 in 2.099s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:00 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc Jul 07 10:39:00 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:00 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e6df7a5b-26e7-4e5b-b55c-9ba63150321c" returned: 0 in 0.925s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-quobyte-e6df7a5b-26e7-4e5b-b55c-9ba63150321c" released by "delete_volume" :: held 2.674s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Created reservations ['999bb1e0-4bc5-4e3c-8523-7cfc53c9c652', 'be63e257-f2ae-4b31-8356-c5710605564e', '2dfcf11f-3fd7-401a-a08f-0eeffcc7b026', '2970e1c5-126c-4339-95a9-5cb56684aa07'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:00 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:00 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "cinder-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:01 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" returned: 0 in 0.852s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] <== create_volume: return (3050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.054s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39566eec-13e1-4930-9eb7-52d9b3895981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf43018-3dc9-411f-b994-b09613fe0a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:01 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Volume volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc (9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc): created successfully Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf43018-3dc9-411f-b994-b09613fe0a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Flow 'volume_create_manager' (a2a272aa-d9ef-42c9-93b1-984bc240d7d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "cinder-quobyte-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1b3a288e-5bce-4f62-a58f-bd62e0d0d6cd tempest-GroupsV314Test-615241368 None] Created volume successfully. Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-quobyte-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[59575956-8d3e-48b1-9c63-364c7a30f110]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:01 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.823s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Deleted volume successfully. Jul 07 10:39:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7f64fd1d-9d23-4bd0-8056-828ed40a13b8 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-e6df7a5b-26e7-4e5b-b55c-9ba63150321c-delete_volume" released by "delete_volume" :: held 3.774s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:01 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff Jul 07 10:39:01 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:02 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff" returned: 0 in 1.078s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:02 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff Jul 07 10:39:02 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Flow 'volume_create_manager' (b0919b0a-246b-49f3-bf98-ee685e9d9ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4807796-4ab1-428c-a4ec-c90cb172f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4807796-4ab1-428c-a4ec-c90cb172f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-424335696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d00352e-de71-409e-b524-19b34567f481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef8718e7c164a22a98c247edb5b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:03Z,use_quota=True,user_id='3d4f44eedd734405a339f04a133723b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e88c47-9738-49d7-a556-7c34b4f27613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e88c47-9738-49d7-a556-7c34b4f27613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e174ab-2185-48d5-967e-43d8554f77f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e174ab-2185-48d5-967e-43d8554f77f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d00352e-de71-409e-b524-19b34567f481', 'volume_name': 'volume-0d00352e-de71-409e-b524-19b34567f481', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5a12fb-4727-4be8-a2c5-b526ccff820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5a12fb-4727-4be8-a2c5-b526ccff820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f70aee-67c6-4861-a0ea-6ada522b0986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:03 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Volume 0d00352e-de71-409e-b524-19b34567f481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d00352e-de71-409e-b524-19b34567f481', 'volume_size': 1} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-424335696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d00352e-de71-409e-b524-19b34567f481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef8718e7c164a22a98c247edb5b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:03Z,use_quota=True,user_id='3d4f44eedd734405a339f04a133723b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Creating volume 0d00352e-de71-409e-b524-19b34567f481 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:03 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:03 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 1073741824 Jul 07 10:39:03 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:03 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff" returned: 0 in 0.895s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-quobyte-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff" released by "delete_volume" :: held 2.067s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Created reservations ['2f4680fc-cd73-4b4e-b6ec-6c212ee4f9a9', 'b326cbde-7bc6-4e91-9632-dc53087cc779', '636caeaf-524d-40ca-b5ed-001999ab6efe', '1efaea50-50c4-43b9-9815-153a5e401efe'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:03 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:03 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:04 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 1073741824" returned: 0 in 1.304s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:04 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 Jul 07 10:39:04 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:04 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.806s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:04 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Deleted volume successfully. Jul 07 10:39:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ac5f974e-6353-4fa1-87a0-1f212df1ac69 tempest-VolumesListAdminTestJSON-2093788262 None] Lock "cinder-bd5ab007-14f6-40eb-8f9f-a8ecf844b5ff-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:05 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481" returned: 0 in 0.791s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.616s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:05 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Cloning volume 9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc to volume 42286f71-b3f9-4005-84b8-7a57b32928b7 Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f70aee-67c6-4861-a0ea-6ada522b0986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d00352e-de71-409e-b524-19b34567f481', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d9caef-5d60-4ec4-8983-3b18ea4c548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:05 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Volume volume-0d00352e-de71-409e-b524-19b34567f481 (0d00352e-de71-409e-b524-19b34567f481): created successfully Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d9caef-5d60-4ec4-8983-3b18ea4c548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Flow 'volume_create_manager' (b0919b0a-246b-49f3-bf98-ee685e9d9ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:05 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0a4432a3-60f8-4b08-935e-15d36767ab2e tempest-AttachVolumeNegativeTest-1491468132 None] Created volume successfully. Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Creating offline snapshot 48c928a7-4711-4742-9250-cb0e8b54e04f of volume 9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5ba42f-2cc2-4896-9203-c9a6ef97d8ab]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:05 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc Jul 07 10:39:05 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:06 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" returned: 0 in 0.958s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:06 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f 1G Jul 07 10:39:06 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:07 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f 1G" returned: 0 in 0.997s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:07 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f Jul 07 10:39:07 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:08 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f" returned: 0 in 0.757s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:08 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:39:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:08 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f Jul 07 10:39:08 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:08 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f" returned: 0 in 0.765s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:09 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.info Jul 07 10:39:09 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Flow 'volume_create_manager' (51266cde-8141-4b9a-8bab-d5d1904fbcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da52f872-381c-42cd-9356-cbd5396ba47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da52f872-381c-42cd-9356-cbd5396ba47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1949561640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f561322-57ba-4141-b8de-c0c9a3babce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c579a9b5a81646a6aae0979e594d6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:09Z,use_quota=True,user_id='95056d68ba38421d852ad61dbd11fc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd2e95e-a5c5-4a59-a45b-9495ecebc8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd2e95e-a5c5-4a59-a45b-9495ecebc8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efd18ce-5352-4456-a37e-5a333cb7ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efd18ce-5352-4456-a37e-5a333cb7ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f561322-57ba-4141-b8de-c0c9a3babce3', 'volume_name': 'volume-0f561322-57ba-4141-b8de-c0c9a3babce3', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4a73db-f7df-4ddb-8d83-c1dc4c3bc27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4a73db-f7df-4ddb-8d83-c1dc4c3bc27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf48aac2-37aa-4491-ad5e-149ae2946bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:09 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Volume 0f561322-57ba-4141-b8de-c0c9a3babce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f561322-57ba-4141-b8de-c0c9a3babce3', 'volume_size': 1} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3e3828bc-5091-4689-aafc-de8bba5843aa req-ef239b83-2b9a-4934-adc8-d8d7450e7068 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:09 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.info" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:09 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:39:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:09 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.info Jul 07 10:39:09 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:10 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.info" returned: 0 in 0.666s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Acquiring lock "cinder-quobyte-42286f71-b3f9-4005-84b8-7a57b32928b7" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-42286f71-b3f9-4005-84b8-7a57b32928b7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] snapshot: 48c928a7-4711-4742-9250-cb0e8b54e04f, volume: 42286f71-b3f9-4005-84b8-7a57b32928b7, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cd1876-c800-430f-ac93-513d7d78d74a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:10 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f Jul 07 10:39:10 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:11 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f" returned: 0 in 0.792s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:39:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:39:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:39:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4643a8a0-4c93-4dac-aa29-baac35bbab28]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:11 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc Jul 07 10:39:11 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:12 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" returned: 0 in 0.767s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:12 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:39:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:12 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 Jul 07 10:39:12 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:17 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7" returned: 0 in 4.937s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:17 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff7c79-f6fe-45d6-8467-bcea9312386b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:17 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc Jul 07 10:39:17 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:17 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" returned: 0 in 0.898s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:17 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:39:17 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Converted 1024.00 MB image at 207.37 MB/s Jul 07 10:39:17 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:39:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:17 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 Jul 07 10:39:17 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:18 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7" returned: 0 in 0.633s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-42286f71-b3f9-4005-84b8-7a57b32928b7" released by "_copy_volume_from_snapshot" :: held 8.108s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Acquiring lock "cinder-quobyte-48c928a7-4711-4742-9250-cb0e8b54e04f" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-48c928a7-4711-4742-9250-cb0e8b54e04f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Deleting offline snapshot 48c928a7-4711-4742-9250-cb0e8b54e04f of volume 9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] snapshot_file for this snap is: volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f8a046-1cbf-45d4-a5b4-f2945518e2c2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:18 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f Jul 07 10:39:18 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:19 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f" returned: 0 in 0.730s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:39:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[98691fab-d114-4e6e-a638-231419feb13d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:19 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:DELETE=4,cinder:SELECT=33,cinder:UPDATE=46,cinder:INSERT=13 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:39:19 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc Jul 07 10:39:19 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:20 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" returned: 0 in 0.795s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:20 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f Jul 07 10:39:20 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:20 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f" returned: 0 in 0.732s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:20 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f Jul 07 10:39:20 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:21 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc.48c928a7-4711-4742-9250-cb0e8b54e04f" returned: 0 in 0.637s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-48c928a7-4711-4742-9250-cb0e8b54e04f" released by "_delete_snapshot" :: held 2.981s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.285s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.260s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1949561640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f561322-57ba-4141-b8de-c0c9a3babce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c579a9b5a81646a6aae0979e594d6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:09Z,use_quota=True,user_id='95056d68ba38421d852ad61dbd11fc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Creating volume 0f561322-57ba-4141-b8de-c0c9a3babce3 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:21 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:21 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 1073741824 Jul 07 10:39:21 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-be3066f7-1513-4d36-9dd0-e83f3f354850 tempest-GroupsV314Test-615241368 None] Create group from source-group-06bf0b79-9003-494c-a5a6-f2d5e3fc1328 completed successfully. Jul 07 10:39:22 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 1073741824" returned: 0 in 0.839s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:22 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 Jul 07 10:39:22 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Acquiring lock "cinder-quobyte-42286f71-b3f9-4005-84b8-7a57b32928b7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-42286f71-b3f9-4005-84b8-7a57b32928b7" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff1070e-610d-44a2-be68-4f8722db5e20]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:22 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 Jul 07 10:39:22 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:23 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3" returned: 0 in 0.637s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3e3828bc-5091-4689-aafc-de8bba5843aa req-ef239b83-2b9a-4934-adc8-d8d7450e7068 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.654s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf48aac2-37aa-4491-ad5e-149ae2946bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f561322-57ba-4141-b8de-c0c9a3babce3', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae0da46-4b07-4761-a797-397c4f6ccbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02af183-378d-4b93-80e0-654c1fbd97a6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-3e3828bc-5091-4689-aafc-de8bba5843aa req-ef239b83-2b9a-4934-adc8-d8d7450e7068 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:23 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Volume volume-0f561322-57ba-4141-b8de-c0c9a3babce3 (0f561322-57ba-4141-b8de-c0c9a3babce3): created successfully Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae0da46-4b07-4761-a797-397c4f6ccbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Flow 'volume_create_manager' (51266cde-8141-4b9a-8bab-d5d1904fbcd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d4506e37-c2bf-46ae-856a-560069bde028 tempest-VolumesMetadataTest-1856629478 None] Created volume successfully. Jul 07 10:39:23 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 Jul 07 10:39:23 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:23 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7" returned: 0 in 0.798s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:23 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7 Jul 07 10:39:23 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:23 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:23 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:24 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-3e3828bc-5091-4689-aafc-de8bba5843aa req-ef239b83-2b9a-4934-adc8-d8d7450e7068 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481" returned: 0 in 0.940s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3e3828bc-5091-4689-aafc-de8bba5843aa req-ef239b83-2b9a-4934-adc8-d8d7450e7068 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3e3828bc-5091-4689-aafc-de8bba5843aa req-ef239b83-2b9a-4934-adc8-d8d7450e7068 tempest-AttachVolumeNegativeTest-1491468132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-0d00352e-de71-409e-b524-19b34567f481', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fd8ecd4-449b-4a01-bb0f-ad025c05cb9c', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:39:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-3e3828bc-5091-4689-aafc-de8bba5843aa req-ef239b83-2b9a-4934-adc8-d8d7450e7068 tempest-AttachVolumeNegativeTest-1491468132 None] attachment_update completed successfully. Jul 07 10:39:24 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-42286f71-b3f9-4005-84b8-7a57b32928b7" returned: 0 in 0.780s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-42286f71-b3f9-4005-84b8-7a57b32928b7" released by "delete_volume" :: held 1.638s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:24 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.768s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 8 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Created reservations ['0a0db03b-c867-4b26-94fe-9b933374c9bd'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:24 devstack cinder-volume[87208]: WARNING cinder.quota [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-425033059 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-425033059, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:39:24 devstack cinder-volume[87208]: WARNING cinder.quota [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-425033059 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-425033059, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Created reservations ['30e7cdd3-95ea-4a4e-b444-770ac0a17953', 'a9373450-4c58-431c-84c3-e80170fd5646', 'b7e21ccb-9731-4f26-9b1d-b80321da51e0', '56144935-a564-4639-a771-8e82e48f5ba2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:24 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:24 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Acquiring lock "cinder-0f561322-57ba-4141-b8de-c0c9a3babce3-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Lock "cinder-0f561322-57ba-4141-b8de-c0c9a3babce3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Acquiring lock "cinder-quobyte-0f561322-57ba-4141-b8de-c0c9a3babce3" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Lock "cinder-quobyte-0f561322-57ba-4141-b8de-c0c9a3babce3" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc1dd40-e695-4b1a-82af-5f766ce29089]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:24 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 Jul 07 10:39:24 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:25 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:25 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d369e7a1-ea87-4965-bcc6-c04e820d17b8 tempest-GroupsV314Test-615241368 None] Delete group completed successfully. Jul 07 10:39:25 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-d6c66bf1-c36a-46a5-8311-83786286823c req-22267a92-80c1-46b2-9756-f1cd689a9d2c tempest-AttachVolumeTestJSON-1667183289 None] Terminate volume connection completed successfully. Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-d6c66bf1-c36a-46a5-8311-83786286823c req-22267a92-80c1-46b2-9756-f1cd689a9d2c tempest-AttachVolumeTestJSON-1667183289 None] Deleting attachment 8ee9dc32-f2d8-4b8d-813b-62129b98c6c0. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Acquiring lock "cinder-quobyte-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc66415-fd4c-4d3b-9867-b68a2d350b13]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:25 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3" returned: 0 in 0.893s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:25 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc Jul 07 10:39:25 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:25 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3 Jul 07 10:39:25 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:26 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:26 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" returned: 0 in 0.801s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f561322-57ba-4141-b8de-c0c9a3babce3" returned: 0 in 0.694s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Lock "cinder-quobyte-0f561322-57ba-4141-b8de-c0c9a3babce3" released by "delete_volume" :: held 1.640s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:26 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc Jul 07 10:39:26 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Created reservations ['029dcf63-40a2-4549-a571-1ea768db87dc', '3ae724a6-44c8-40e5-a262-2ef7bc69a1a3', '842993d0-bb52-4c47-8659-9de252d5e14c', 'd6736b0e-bf74-4709-9247-cf0fab122323'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:26 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:26 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:27 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" returned: 0 in 0.784s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Lock "cinder-quobyte-9367ca02-57b2-4fe0-b0d2-b8196aa8d6dc" released by "delete_volume" :: held 1.652s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Created reservations ['53233bad-1fb9-4a3b-b650-3e12d0c558aa'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Created reservations ['a09e02ca-094c-4416-a4d5-7769aa27da52', '1b41fd69-d6a1-4557-bcb1-96b8719d9f29', 'a17c951a-eddd-4629-acf0-4a73011566fd', 'cccb2a72-494b-4359-b438-57059dbafbf6'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:27 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.729s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Deleted volume successfully. Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-79eb2d37-59dd-4b31-9bc9-f18f57db9194 tempest-VolumesMetadataTest-1856629478 None] Lock "cinder-0f561322-57ba-4141-b8de-c0c9a3babce3-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:27 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:27 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:28 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.941s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:28 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:28 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c6160e2a-ea61-4a40-ad3e-ed25b5cb1548 tempest-GroupsV314Test-615241368 None] Delete group completed successfully. Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Flow 'volume_create_manager' (1aff60ea-0f60-46f1-bec6-329cc8763887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb5ecdd-b671-40bc-8366-a6fc11e3619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb5ecdd-b671-40bc-8366-a6fc11e3619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-679011828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d1abb6-c61b-472b-b38b-aa3dbd3d734c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dc63f76c7846dba343844922b216c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:30Z,use_quota=True,user_id='8076c20715584a55a84ed480c8701226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5061aa-763c-4677-9c9a-c2d9a9af532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5061aa-763c-4677-9c9a-c2d9a9af532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec84ec9-495f-42fb-a189-9b65d42d83fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec84ec9-495f-42fb-a189-9b65d42d83fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d1abb6-c61b-472b-b38b-aa3dbd3d734c', 'volume_name': 'volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c', 'volume_size': 2}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00770dfe-5523-4c5f-8148-04e30c43692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00770dfe-5523-4c5f-8148-04e30c43692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e1457b-5db9-44b1-ae56-917da99d9dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:30 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Volume a2d1abb6-c61b-472b-b38b-aa3dbd3d734c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c', 'volume_size': 2} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-679011828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d1abb6-c61b-472b-b38b-aa3dbd3d734c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dc63f76c7846dba343844922b216c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:30Z,use_quota=True,user_id='8076c20715584a55a84ed480c8701226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Creating volume a2d1abb6-c61b-472b-b38b-aa3dbd3d734c {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:30 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c 2147483648 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:30 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c 2147483648 Jul 07 10:39:30 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-4ffc7321-289a-49e2-bc93-3911e0d0f69a req-59b863b8-e6ed-4f50-8468-3ba795ccc2b2 tempest-AttachVolumeNegativeTest-1491468132 None] Terminate volume connection completed successfully. Jul 07 10:39:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-4ffc7321-289a-49e2-bc93-3911e0d0f69a req-59b863b8-e6ed-4f50-8468-3ba795ccc2b2 tempest-AttachVolumeNegativeTest-1491468132 None] Deleting attachment 6fd8ecd4-449b-4a01-bb0f-ad025c05cb9c. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:39:31 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c 2147483648" returned: 0 in 0.995s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:31 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c Jul 07 10:39:31 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:32 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c" returned: 0 in 0.661s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e1457b-5db9-44b1-ae56-917da99d9dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c', 'volume_size': 2}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f788ae-d4ab-4a59-9ec1-57bc01d457fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:32 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Volume volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c (a2d1abb6-c61b-472b-b38b-aa3dbd3d734c): created successfully Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f788ae-d4ab-4a59-9ec1-57bc01d457fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Flow 'volume_create_manager' (1aff60ea-0f60-46f1-bec6-329cc8763887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:32 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-be29b7f0-d609-498a-ada3-d7f0f09d0dde tempest-VolumesCloneNegativeTest-2014649782 None] Created volume successfully. Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Acquiring lock "cinder-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Lock "cinder-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Acquiring lock "cinder-quobyte-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Lock "cinder-quobyte-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9baef-e3e5-448a-b758-e478829608e8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:32 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c Jul 07 10:39:32 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:33 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c" returned: 0 in 0.844s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:33 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c Jul 07 10:39:33 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Flow 'volume_create_manager' (999052c6-45af-42c8-9f4b-c03e9a8402fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7d043a-3275-4a7d-b92e-8a746ef421e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7d043a-3275-4a7d-b92e-8a746ef421e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-468245859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef6bd7c-76ce-4062-a398-b3bfe6845bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588cbfbc82e142db9c147740c5a972e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:34Z,use_quota=True,user_id='77762a5aa70f4e26b9d2c365ac66c669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904075ab-d125-4e0d-b600-5e1fa997f869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904075ab-d125-4e0d-b600-5e1fa997f869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43409a1-286d-48b8-bf56-820f9806f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43409a1-286d-48b8-bf56-820f9806f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef6bd7c-76ce-4062-a398-b3bfe6845bc1', 'volume_name': 'volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf9d7e4-3e1c-4514-8bab-08870059c50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf9d7e4-3e1c-4514-8bab-08870059c50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baaa4d8e-c720-427f-a559-8b04bbd4d82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:33 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Volume 3ef6bd7c-76ce-4062-a398-b3bfe6845bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1', 'volume_size': 1} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-468245859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef6bd7c-76ce-4062-a398-b3bfe6845bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588cbfbc82e142db9c147740c5a972e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:34Z,use_quota=True,user_id='77762a5aa70f4e26b9d2c365ac66c669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Creating volume 3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:33 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:33 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 1073741824 Jul 07 10:39:33 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:34 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c" returned: 0 in 0.713s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Lock "cinder-quobyte-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c" released by "delete_volume" :: held 1.621s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Created reservations ['52ee689c-9f1c-48d6-b427-7e3acaba3ebe', '587d2b14-6d8d-43f5-9ff7-7643194d4ffd', 'd8e47227-9e8d-4c2e-94bd-412d624bc3dc', 'b57b925f-0ba6-4d84-b9f1-8b474784389a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:34 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:34 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:34 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 1073741824" returned: 0 in 1.090s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:35 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 Jul 07 10:39:35 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:35 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.348s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:35 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:35 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Deleted volume successfully. Jul 07 10:39:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-178c445f-87d0-4346-be92-1d29e9eea6b3 tempest-VolumesCloneNegativeTest-2014649782 None] Lock "cinder-a2d1abb6-c61b-472b-b38b-aa3dbd3d734c-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:36 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1" returned: 0 in 0.980s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baaa4d8e-c720-427f-a559-8b04bbd4d82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc993c5-7e96-4803-a7e5-6520aedca0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Volume volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 (3ef6bd7c-76ce-4062-a398-b3bfe6845bc1): created successfully Jul 07 10:39:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc993c5-7e96-4803-a7e5-6520aedca0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Flow 'volume_create_manager' (999052c6-45af-42c8-9f4b-c03e9a8402fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-99b22323-cafb-46e4-98f9-1bfe55504950 tempest-VolumesServicesTestJSON-252847463 None] Created volume successfully. Jul 07 10:39:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Acquiring lock "cinder-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Lock "cinder-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Acquiring lock "cinder-quobyte-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Lock "cinder-quobyte-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4db022-dd65-4db5-95d6-303138375007]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:37 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 Jul 07 10:39:37 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:38 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1" returned: 0 in 1.133s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:38 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1 Jul 07 10:39:38 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:39 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (8d0a83a9-00f4-4803-9a6e-ca5cc08f9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef972c0-82ec-4b49-b729-7562497d1b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1" returned: 0 in 1.190s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef972c0-82ec-4b49-b729-7562497d1b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519478487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2b282b-0380-465f-ac66-2fa538efc6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:40Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69903ea-6ebc-427b-b6a0-08a74e5fb6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69903ea-6ebc-427b-b6a0-08a74e5fb6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fa69b5-9103-483e-82e9-2214da6927e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fa69b5-9103-483e-82e9-2214da6927e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2b282b-0380-465f-ac66-2fa538efc6e2', 'volume_name': 'volume-bf2b282b-0380-465f-ac66-2fa538efc6e2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc64860-cd5c-4cac-9704-7a63cebb74c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc64860-cd5c-4cac-9704-7a63cebb74c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdba529-f1e8-4c5a-889e-d43bdc4d305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:39 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume bf2b282b-0380-465f-ac66-2fa538efc6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2b282b-0380-465f-ac66-2fa538efc6e2', 'volume_size': 1} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519478487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2b282b-0380-465f-ac66-2fa538efc6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:40Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Creating volume bf2b282b-0380-465f-ac66-2fa538efc6e2 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:39 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Lock "cinder-quobyte-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1" released by "delete_volume" :: held 2.451s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:39 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 1073741824 Jul 07 10:39:39 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Created reservations ['42873667-d618-46bc-8351-3b36118d0072', 'b865ad93-4a29-4357-9113-d43b9d41b48d', 'aadac822-5a08-4f34-bab2-9e5343806e5e', '8ac5ba75-6f09-437a-be34-0d13785e630e'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:40 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:40 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:40 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:40 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Deleted volume successfully. Jul 07 10:39:40 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 1073741824" returned: 0 in 1.126s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8f4718a2-3efb-4e7e-82aa-2181ac334f50 tempest-VolumesServicesTestJSON-252847463 None] Lock "cinder-3ef6bd7c-76ce-4062-a398-b3bfe6845bc1-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:41 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 Jul 07 10:39:41 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:42 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2" returned: 0 in 1.215s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] <== create_volume: return (2438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.439s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdba529-f1e8-4c5a-889e-d43bdc4d305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2b282b-0380-465f-ac66-2fa538efc6e2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02a903e-5ee0-4127-90df-03c0aba88a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:42 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 (bf2b282b-0380-465f-ac66-2fa538efc6e2): created successfully Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02a903e-5ee0-4127-90df-03c0aba88a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (8d0a83a9-00f4-4803-9a6e-ca5cc08f9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-76983b8f-f35a-405d-b6a5-da418b071e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created volume successfully. Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "cinder-0d00352e-de71-409e-b524-19b34567f481-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-0d00352e-de71-409e-b524-19b34567f481-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "cinder-quobyte-0d00352e-de71-409e-b524-19b34567f481" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-quobyte-0d00352e-de71-409e-b524-19b34567f481" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb07b382-7743-4c3e-b784-7b41b5bb999f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:42 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 Jul 07 10:39:42 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:43 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481" returned: 0 in 0.938s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:43 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481 Jul 07 10:39:43 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (e72051cb-6c9a-467e-b9b3-f885a2f752c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09940614-0662-4ed1-aac8-d57e74f94b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09940614-0662-4ed1-aac8-d57e74f94b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1456008266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddbbada-db3d-4419-827b-776fa6b4fe42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:44Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07770d34-ed67-4508-8225-3429e8675ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07770d34-ed67-4508-8225-3429e8675ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1174a73d-ddae-46cc-aef0-1a0492fdc422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1174a73d-ddae-46cc-aef0-1a0492fdc422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddbbada-db3d-4419-827b-776fa6b4fe42', 'volume_name': 'volume-2ddbbada-db3d-4419-827b-776fa6b4fe42', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca8d587-0a65-47f0-8ba3-7b92673b59af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca8d587-0a65-47f0-8ba3-7b92673b59af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bb774c-d1dc-461f-973d-e71b515dc799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume 2ddbbada-db3d-4419-827b-776fa6b4fe42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddbbada-db3d-4419-827b-776fa6b4fe42', 'volume_size': 1} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1456008266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddbbada-db3d-4419-827b-776fa6b4fe42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:44Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Creating volume 2ddbbada-db3d-4419-827b-776fa6b4fe42 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:43 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:43 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 1073741824 Jul 07 10:39:43 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (4114ebe3-de70-4ee0-98e1-4a6bad4c487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822de0c2-5142-4605-b5b7-8d9fe71e587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822de0c2-5142-4605-b5b7-8d9fe71e587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463803561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3648a6d6-9345-4452-885a-ddf0f04c7b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:44Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279a705b-3808-4a66-8f16-3e96b9cf6482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279a705b-3808-4a66-8f16-3e96b9cf6482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a425535-bfff-46d6-b7e7-fbf830a4fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a425535-bfff-46d6-b7e7-fbf830a4fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3648a6d6-9345-4452-885a-ddf0f04c7b81', 'volume_name': 'volume-3648a6d6-9345-4452-885a-ddf0f04c7b81', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1f4754-e1c8-4e82-a63d-43bba6b3436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1f4754-e1c8-4e82-a63d-43bba6b3436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0446860d-daa9-4960-8c83-77a26d1e63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:44 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume 3648a6d6-9345-4452-885a-ddf0f04c7b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3648a6d6-9345-4452-885a-ddf0f04c7b81', 'volume_size': 1} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:44 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0d00352e-de71-409e-b524-19b34567f481" returned: 0 in 1.503s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-quobyte-0d00352e-de71-409e-b524-19b34567f481" released by "delete_volume" :: held 2.508s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Created reservations ['e6e346eb-eb8f-400c-a0f4-4dbb6edffaee', '0b573f1c-9c33-472e-9590-5b4475b098da', '875e7b4b-b1d8-42f1-b895-14f07a64a0f9', 'ce90f2f9-85d7-4360-be36-6eac69edb9e1'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (f21ac2d4-a29a-4c2b-83bd-46e7053c5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fa9b43-9ba8-4b1a-8ab8-ac44fa03f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fa9b43-9ba8-4b1a-8ab8-ac44fa03f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438858571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6b42e9-ec8f-43d7-be80-192af036a8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:45Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef9ecc0-8b76-4542-9928-c2fd6ee5f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef9ecc0-8b76-4542-9928-c2fd6ee5f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50a7367-e246-4f9b-95c7-aba79d901248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50a7367-e246-4f9b-95c7-aba79d901248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6b42e9-ec8f-43d7-be80-192af036a8ae', 'volume_name': 'volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed049f2-9ce2-47ed-9137-f9e9973a6ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed049f2-9ce2-47ed-9137-f9e9973a6ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c04a76c-ea70-4f40-9fe4-ad1ab4c89dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume 9e6b42e9-ec8f-43d7-be80-192af036a8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae', 'volume_size': 1} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:45 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:45 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:45 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 1073741824" returned: 0 in 1.783s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (7e634be7-2dcc-4b1d-abfd-71fa274d9f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed94841-8c44-46b0-b410-79c3a7827f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed94841-8c44-46b0-b410-79c3a7827f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:46Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d333c65c-002b-4d4e-934b-e489c60458fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d333c65c-002b-4d4e-934b-e489c60458fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b68b4a-ead8-4a13-bcd5-6429c91c24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b68b4a-ead8-4a13-bcd5-6429c91c24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7', 'volume_name': 'volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cccefa-5f79-47fc-8efb-0de21005af20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cccefa-5f79-47fc-8efb-0de21005af20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf5d1d3-7d4a-4ccc-a27e-1290affec1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:45 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume 43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7', 'volume_size': 1} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:45 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 Jul 07 10:39:45 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "cinder-1dbbe0af-53c3-4143-95c0-2bf897d9defa-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-1dbbe0af-53c3-4143-95c0-2bf897d9defa-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "cinder-quobyte-1dbbe0af-53c3-4143-95c0-2bf897d9defa" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-quobyte-1dbbe0af-53c3-4143-95c0-2bf897d9defa" acquired by "delete_volume" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d64875-d614-4e14-9723-51f5f6c5e033]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:46 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa Jul 07 10:39:46 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:46 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.266s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:46 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Deleted volume successfully. Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b26b3f33-0521-4ebf-84a4-e84a3da47baa tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-0d00352e-de71-409e-b524-19b34567f481-delete_volume" released by "delete_volume" :: held 4.326s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (081da417-3cdb-4bd8-9d97-7c72cd370b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e420c0c-48d3-4719-9634-1f27e238944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e420c0c-48d3-4719-9634-1f27e238944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749721227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765ca40d-a00e-424a-98b4-8f00b38d6e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:47Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80109782-60f2-4245-bf4b-397e6d2b23e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80109782-60f2-4245-bf4b-397e6d2b23e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3957398-9815-4cef-b092-6183b5bd9dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3957398-9815-4cef-b092-6183b5bd9dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765ca40d-a00e-424a-98b4-8f00b38d6e33', 'volume_name': 'volume-765ca40d-a00e-424a-98b4-8f00b38d6e33', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c754a0-4877-4788-b7b5-daa098c3c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c754a0-4877-4788-b7b5-daa098c3c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521b9e9e-d3c5-4206-8c06-4b490ad47e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume 765ca40d-a00e-424a-98b4-8f00b38d6e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765ca40d-a00e-424a-98b4-8f00b38d6e33', 'volume_size': 1} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:47 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42" returned: 0 in 1.206s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] <== create_volume: return (3202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.207s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463803561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3648a6d6-9345-4452-885a-ddf0f04c7b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:44Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Creating volume 3648a6d6-9345-4452-885a-ddf0f04c7b81 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:47 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:47 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 1073741824 Jul 07 10:39:47 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bb774c-d1dc-461f-973d-e71b515dc799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddbbada-db3d-4419-827b-776fa6b4fe42', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c19cb98-ad2f-4c9a-ae98-9d1ef6a4d145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 (2ddbbada-db3d-4419-827b-776fa6b4fe42): created successfully Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c19cb98-ad2f-4c9a-ae98-9d1ef6a4d145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (e72051cb-6c9a-467e-b9b3-f885a2f752c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8cad4101-33cd-4f14-836a-9f820c71ee91 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created volume successfully. Jul 07 10:39:47 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa" returned: 0 in 1.291s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:47 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa Jul 07 10:39:47 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:48 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 1073741824" returned: 0 in 1.105s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:48 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 Jul 07 10:39:48 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:48 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1dbbe0af-53c3-4143-95c0-2bf897d9defa" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-quobyte-1dbbe0af-53c3-4143-95c0-2bf897d9defa" released by "delete_volume" :: held 2.220s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Created reservations ['b3ed06aa-2219-491d-8610-3131ec59fc42', '094e0b8a-01b1-4362-852f-d4de7b793975', 'e56737d6-6051-4c4c-9aea-019821f4a5b0', 'e1d6985d-5b39-4e5e-9c6e-5a501faa02b2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:48 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:48 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:49 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81" returned: 0 in 0.778s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.769s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438858571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6b42e9-ec8f-43d7-be80-192af036a8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:45Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Creating volume 9e6b42e9-ec8f-43d7-be80-192af036a8ae {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:49 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0446860d-daa9-4960-8c83-77a26d1e63da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3648a6d6-9345-4452-885a-ddf0f04c7b81', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:49 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae 1073741824 Jul 07 10:39:49 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fb4007-fd47-4020-85f8-8656a9ab39c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:49 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 (3648a6d6-9345-4452-885a-ddf0f04c7b81): created successfully Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fb4007-fd47-4020-85f8-8656a9ab39c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (4114ebe3-de70-4ee0-98e1-4a6bad4c487b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c75cb613-5d2b-4318-bdf6-2809f535501a tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created volume successfully. Jul 07 10:39:49 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.033s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Deleted volume successfully. Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-da35a8ef-4341-4deb-be1d-2fabaa089a10 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-1dbbe0af-53c3-4143-95c0-2bf897d9defa-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "cinder-3ba7c009-10ec-431d-b426-dc230f2ec4e6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-3ba7c009-10ec-431d-b426-dc230f2ec4e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "cinder-quobyte-3ba7c009-10ec-431d-b426-dc230f2ec4e6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-quobyte-3ba7c009-10ec-431d-b426-dc230f2ec4e6" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ddfbd-a9fa-4eb8-9b59-548bf477407b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:50 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 Jul 07 10:39:50 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:50 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae 1073741824" returned: 0 in 1.254s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:50 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=134,cinder:SELECT=101,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:39:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:50 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae Jul 07 10:39:50 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:51 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6" returned: 0 in 1.004s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:51 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6 Jul 07 10:39:51 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:51 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae" returned: 0 in 1.030s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.537s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:46Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Creating volume 43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:51 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:51 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 1073741824 Jul 07 10:39:51 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c04a76c-ea70-4f40-9fe4-ad1ab4c89dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31004459-7899-4c59-8ddf-ec4715e61272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:51 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae (9e6b42e9-ec8f-43d7-be80-192af036a8ae): created successfully Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31004459-7899-4c59-8ddf-ec4715e61272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (f21ac2d4-a29a-4c2b-83bd-46e7053c5f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ad1b26e4-be5c-495c-a128-ae5422bcf598 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created volume successfully. Jul 07 10:39:51 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3ba7c009-10ec-431d-b426-dc230f2ec4e6" returned: 0 in 0.952s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-quobyte-3ba7c009-10ec-431d-b426-dc230f2ec4e6" released by "delete_volume" :: held 2.011s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Created reservations ['be79fdb7-e853-4734-903c-6e9417ec9a9a', '833ea19b-5d0b-4903-afef-8f1830327822', '5633bbc3-2af7-4f97-97ee-ca293a37ee30', '6322e85d-479a-4d26-be84-9acdd245d1cf'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:52 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:52 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:52 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 1073741824" returned: 0 in 1.290s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:52 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 Jul 07 10:39:52 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:53 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.757s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Deleted volume successfully. Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f906abd5-f116-4844-9f49-0dc884435d01 tempest-AttachVolumeNegativeTest-1491468132 None] Lock "cinder-3ba7c009-10ec-431d-b426-dc230f2ec4e6-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:53 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7" returned: 0 in 0.784s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.537s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749721227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765ca40d-a00e-424a-98b4-8f00b38d6e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce533ea70b740d0b6be7dee4955f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:47Z,use_quota=True,user_id='e4809d580d4446279d375380f427184b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Creating volume 765ca40d-a00e-424a-98b4-8f00b38d6e33 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:53 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:53 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 1073741824 Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf5d1d3-7d4a-4ccc-a27e-1290affec1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:53 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb6fcd4-fbf0-44f0-af90-cd61f8bb8dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:53 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 (43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7): created successfully Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb6fcd4-fbf0-44f0-af90-cd61f8bb8dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (7e634be7-2dcc-4b1d-abfd-71fa274d9f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1578ea54-1f09-44f1-81b1-77ee42260782 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created volume successfully. Jul 07 10:39:54 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 1073741824" returned: 0 in 0.927s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:54 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 Jul 07 10:39:54 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:55 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33" returned: 0 in 0.726s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521b9e9e-d3c5-4206-8c06-4b490ad47e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765ca40d-a00e-424a-98b4-8f00b38d6e33', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd956000-9de5-47a5-9a73-92088274857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Volume volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 (765ca40d-a00e-424a-98b4-8f00b38d6e33): created successfully Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd956000-9de5-47a5-9a73-92088274857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Flow 'volume_create_manager' (081da417-3cdb-4bd8-9d97-7c72cd370b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b20473a8-5a86-4539-a44f-b171a903e406 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created volume successfully. Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-765ca40d-a00e-424a-98b4-8f00b38d6e33-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-765ca40d-a00e-424a-98b4-8f00b38d6e33-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-quobyte-765ca40d-a00e-424a-98b4-8f00b38d6e33" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-765ca40d-a00e-424a-98b4-8f00b38d6e33" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526993d-4c55-491c-99c6-d184c610a205]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:56 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 Jul 07 10:39:56 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:56 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33" returned: 0 in 0.950s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:56 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33 Jul 07 10:39:56 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (c85e0502-f02c-4e34-9196-b786f01e3cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a4941d-3ef7-451e-a42c-a32600b36071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a4941d-3ef7-451e-a42c-a32600b36071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-593185422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f51cc30-09d3-47fd-adf1-7d5602aaf9c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:58Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:57 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af148958-294e-4cf0-b5b9-ef3fc33080e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af148958-294e-4cf0-b5b9-ef3fc33080e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eae0641-2e9d-45a9-8ece-b6a9d41291e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eae0641-2e9d-45a9-8ece-b6a9d41291e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f51cc30-09d3-47fd-adf1-7d5602aaf9c1', 'volume_name': 'volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6ddac3-8d08-433e-a3c3-a1317fb518c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6ddac3-8d08-433e-a3c3-a1317fb518c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af6e568-b487-422d-9ade-11e516ed3f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Volume 0f51cc30-09d3-47fd-adf1-7d5602aaf9c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1', 'volume_size': 1} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-593185422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f51cc30-09d3-47fd-adf1-7d5602aaf9c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:39:58Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Creating volume 0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:39:57 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-765ca40d-a00e-424a-98b4-8f00b38d6e33" returned: 0 in 0.740s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-765ca40d-a00e-424a-98b4-8f00b38d6e33" released by "delete_volume" :: held 1.737s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:57 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 1073741824 Jul 07 10:39:57 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created reservations ['b242b6d7-0370-474d-b994-69b631830f65', '5a281d07-c95b-40f7-8032-4bc56e4b88cb', 'fac543df-6d9b-478d-88eb-b10a81357d74', '8bb14787-e63b-463e-b370-9da86721c174'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:57 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:39:57 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-quobyte-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f48714-8e51-40fb-acc6-36f54ad023a4]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:58 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 Jul 07 10:39:58 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:58 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.794s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:39:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Deleted volume successfully. Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fada6987-b6ac-4961-9266-d4cf721d1381 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-765ca40d-a00e-424a-98b4-8f00b38d6e33-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:39:58 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 1073741824" returned: 0 in 1.054s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:58 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 Jul 07 10:39:58 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:59 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7" returned: 0 in 0.960s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:39:59 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7 Jul 07 10:39:59 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:39:59 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af6e568-b487-422d-9ade-11e516ed3f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f115620-3ed6-4011-98c4-ac696d3dfa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:39:59 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Volume volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 (0f51cc30-09d3-47fd-adf1-7d5602aaf9c1): created successfully Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f115620-3ed6-4011-98c4-ac696d3dfa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (c85e0502-f02c-4e34-9196-b786f01e3cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:39:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bf498e3d-e18d-4394-a78f-c3184350992c tempest-VolumesGetTest-1855081002 None] Created volume successfully. Jul 07 10:39:59 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7" returned: 0 in 0.728s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:39:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7" released by "delete_volume" :: held 1.730s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created reservations ['f2d66494-820b-4530-adef-8faf1bdc1e3e', '7958cac1-3751-44d3-99e2-c7f1a876273a', '7d5a041d-30e2-4aed-8faf-fcbc78d6cfd6', '2de64ec7-35b5-40eb-ba53-53dc2298da7c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:00 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:00 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-9e6b42e9-ec8f-43d7-be80-192af036a8ae-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-9e6b42e9-ec8f-43d7-be80-192af036a8ae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-quobyte-9e6b42e9-ec8f-43d7-be80-192af036a8ae" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-9e6b42e9-ec8f-43d7-be80-192af036a8ae" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bd9290-19fe-4d6b-aafe-b95e0b3975b0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:00 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae Jul 07 10:40:00 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Flow 'volume_create_manager' (51e989dc-6d0f-4189-8a0d-be8038804800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58299340-d627-4835-bb35-33a0f256ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58299340-d627-4835-bb35-33a0f256ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2062590639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d880d5494cc4328baf10ad3f1b17559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:01Z,use_quota=True,user_id='8208c6896cd34ee58d233b7aeca4717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b85c25-3694-425d-b25a-5ae09f4d0877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b85c25-3694-425d-b25a-5ae09f4d0877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4c7390-84eb-44b3-a6af-347869343c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4c7390-84eb-44b3-a6af-347869343c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce', 'volume_name': 'volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb73fac1-d0eb-4781-9284-b9bc02c2efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb73fac1-d0eb-4781-9284-b9bc02c2efb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:00 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd50081d-b3c2-4816-910a-82e5df688011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:00 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Volume a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce', 'volume_size': 1} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2062590639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d880d5494cc4328baf10ad3f1b17559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:01Z,use_quota=True,user_id='8208c6896cd34ee58d233b7aeca4717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Creating volume a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:00 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.800s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Deleted volume successfully. Jul 07 10:40:00 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce 1073741824 Jul 07 10:40:00 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4afed17a-7ca6-49be-adbd-078e871cdad4 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-43f9f2cc-2ce0-4ef4-a8e4-fcaf279325c7-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:01 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (624db96f-bb88-4942-a24a-1873b6d058a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f716dc-cc68-48c7-b25d-2416d86f3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae" returned: 0 in 0.955s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f716dc-cc68-48c7-b25d-2416d86f3000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-650265659',display_name='tempest-VolumesGetTest-Volume-704575510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52531d4-82e6-445d-a895-4bb4e2cba9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:01Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b501fbd3-93f9-4d26-9f2a-4de9643ddbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:01 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b501fbd3-93f9-4d26-9f2a-4de9643ddbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:01 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59dcc4a-cc66-41c0-b4a8-395b57ed6811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59dcc4a-cc66-41c0-b4a8-395b57ed6811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52531d4-82e6-445d-a895-4bb4e2cba9a7', 'volume_name': 'volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d63f13-07fa-4404-a2dd-4a6c085f4a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d63f13-07fa-4404-a2dd-4a6c085f4a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6825f4-4f72-41f0-bc2d-bfa785b001b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:01 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Volume e52531d4-82e6-445d-a895-4bb4e2cba9a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7', 'volume_size': 1} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:01 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce 1073741824" returned: 0 in 1.018s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:01 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce Jul 07 10:40:01 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:02 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9e6b42e9-ec8f-43d7-be80-192af036a8ae" returned: 0 in 0.700s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-9e6b42e9-ec8f-43d7-be80-192af036a8ae" released by "delete_volume" :: held 1.719s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created reservations ['acb4cb83-12fc-4dd4-86bf-e1e5c9da418f', '47e92c60-a0ce-43b1-b028-eeb7ddc08aad', 'fcc3aecb-35be-4c6a-8852-70a8268893df', '5415ed71-20fa-40dd-a4a3-666970396690'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:02 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:02 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:02 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-650265659',display_name='tempest-VolumesGetTest-Volume-704575510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52531d4-82e6-445d-a895-4bb4e2cba9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:01Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Creating volume e52531d4-82e6-445d-a895-4bb4e2cba9a7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:02 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:02 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 1073741824 Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd50081d-b3c2-4816-910a-82e5df688011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:02 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890fe73d-bbd2-40da-89bd-9ff147f9507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-3648a6d6-9345-4452-885a-ddf0f04c7b81-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:02 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Volume volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce (a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce): created successfully Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890fe73d-bbd2-40da-89bd-9ff147f9507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Flow 'volume_create_manager' (51e989dc-6d0f-4189-8a0d-be8038804800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-3648a6d6-9345-4452-885a-ddf0f04c7b81-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:02 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-8e6de841-72cc-49eb-be76-08ba3fb1b8e8 req-f128c44f-c25a-412b-af52-c4312575795b tempest-VolumesSnapshotsTestJSON-1299839417 None] Created volume successfully. Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-quobyte-3648a6d6-9345-4452-885a-ddf0f04c7b81" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-3648a6d6-9345-4452-885a-ddf0f04c7b81" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d10df0-687f-4e28-814e-59c0bed5b7d3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:03 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 Jul 07 10:40:03 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:03 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.873s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Deleted volume successfully. Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-21e47ce9-e28f-460a-9467-64aca60b8024 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-9e6b42e9-ec8f-43d7-be80-192af036a8ae-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:03 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81" returned: 0 in 1.053s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:03 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 1073741824" returned: 0 in 1.277s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:03 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81 Jul 07 10:40:03 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:04 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 Jul 07 10:40:04 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:04 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.396s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Creating offline snapshot 0cdff2aa-fc85-4807-803c-80bcef696d61 of volume a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:40:04 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3648a6d6-9345-4452-885a-ddf0f04c7b81" returned: 0 in 0.790s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6825f4-4f72-41f0-bc2d-bfa785b001b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0869c36-3099-4c67-8d48-48622b68a1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bdafaa-a8ff-4a7f-80d8-8eb64c8cbf3b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-3648a6d6-9345-4452-885a-ddf0f04c7b81" released by "delete_volume" :: held 1.970s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:04 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Volume volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 (e52531d4-82e6-445d-a895-4bb4e2cba9a7): created successfully Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0869c36-3099-4c67-8d48-48622b68a1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (624db96f-bb88-4942-a24a-1873b6d058a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4a2fdc39-9273-4f88-a8b1-4dceb28b4327 tempest-VolumesGetTest-1855081002 None] Created volume successfully. Jul 07 10:40:04 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created reservations ['cd21db10-48b4-4bed-a586-437671685838', '6bf404ff-3246-4457-815c-6df17c888619', '3047f0ba-f497-4a2e-b93f-45278b10b851', '1f4dfdd9-1f9a-4280-a3c0-eff782fa608c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:04 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce Jul 07 10:40:04 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:05 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:05 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:05 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" returned: 0 in 0.935s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:05 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 1G Jul 07 10:40:05 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:05 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.782s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:05 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Deleted volume successfully. Jul 07 10:40:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3a1d9b85-d0ee-422f-b291-2c3f6ac32e75 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-3648a6d6-9345-4452-885a-ddf0f04c7b81-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-e52531d4-82e6-445d-a895-4bb4e2cba9a7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Lock "cinder-e52531d4-82e6-445d-a895-4bb4e2cba9a7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-e52531d4-82e6-445d-a895-4bb4e2cba9a7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-e52531d4-82e6-445d-a895-4bb4e2cba9a7" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ecc082-7645-4757-98b8-812deb9ad604]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-2ddbbada-db3d-4419-827b-776fa6b4fe42-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-2ddbbada-db3d-4419-827b-776fa6b4fe42-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-quobyte-2ddbbada-db3d-4419-827b-776fa6b4fe42" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-2ddbbada-db3d-4419-827b-776fa6b4fe42" acquired by "delete_volume" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b67243-f32f-42ec-9a02-405bc8ac4fc9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:06 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:06 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:06 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 Jul 07 10:40:06 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:06 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 1G" returned: 0 in 1.009s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:06 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 Jul 07 10:40:06 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:07 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7" returned: 0 in 0.821s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:07 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7 Jul 07 10:40:07 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:07 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42" returned: 0 in 0.837s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:07 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42 Jul 07 10:40:07 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:07 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61" returned: 0 in 0.792s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:07 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 is being set with open permissions: ugo+rw Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:07 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 Jul 07 10:40:07 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:07 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e52531d4-82e6-445d-a895-4bb4e2cba9a7" returned: 0 in 0.735s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-e52531d4-82e6-445d-a895-4bb4e2cba9a7" released by "delete_volume" :: held 1.605s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Created reservations ['c1eb6620-0a08-410c-b0e7-d1a71c4f4bcb', '3ececb70-0397-4b9f-9ecf-b4d0045c3ab8', '93526c86-5c8b-42e7-9c11-d620f38598f4', '634fd03b-db04-4702-a9e4-cc1390defc0c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:07 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:07 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2ddbbada-db3d-4419-827b-776fa6b4fe42" returned: 0 in 0.743s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:07 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-2ddbbada-db3d-4419-827b-776fa6b4fe42" released by "delete_volume" :: held 1.625s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:07 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created reservations ['aef38811-3983-4d09-9839-4f556e3bad57', 'afaf9274-0537-42f2-af10-485769ae5caa', '8128431a-a5c5-4e02-98a2-c48533fd1c76', '585dacd2-a231-484b-a200-738293367a2a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:08 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:08 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:08 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61" returned: 0 in 0.692s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:08 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.info Jul 07 10:40:08 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Lock "cinder-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-bf2b282b-0380-465f-ac66-2fa538efc6e2-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1" acquired by "delete_volume" :: waited 0.041s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-bf2b282b-0380-465f-ac66-2fa538efc6e2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc89387-5ce0-4c63-aa0e-55d588b42524]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "cinder-quobyte-bf2b282b-0380-465f-ac66-2fa538efc6e2" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-bf2b282b-0380-465f-ac66-2fa538efc6e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:08 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.880s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:08 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Deleted volume successfully. Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e644a2-63eb-4567-b4f0-18422fd330b1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0dcfa25-5792-4015-8d3b-da4349a4ac71 tempest-VolumesGetTest-1855081002 None] Lock "cinder-e52531d4-82e6-445d-a895-4bb4e2cba9a7-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:08 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 Jul 07 10:40:08 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:08 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 Jul 07 10:40:08 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:08 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.889s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:08 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Deleted volume successfully. Jul 07 10:40:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40416e58-f9f0-47b3-930f-638d7d618361 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-2ddbbada-db3d-4419-827b-776fa6b4fe42-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:09 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.info" returned: 0 in 0.905s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:09 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.info is being set with open permissions: ugo+rw Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:09 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.info Jul 07 10:40:09 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:09 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1" returned: 0 in 0.869s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:09 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1 Jul 07 10:40:09 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:09 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2" returned: 0 in 0.828s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:09 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2 Jul 07 10:40:09 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:09 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.info" returned: 0 in 0.748s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.239s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-b8afe7a6-fe9b-42fb-8bf8-df381c6709c4 req-ea802f8c-b8ec-40cd-8bb7-5249968d056f tempest-VolumesSnapshotsTestJSON-1299839417 None] Create snapshot completed successfully Jul 07 10:40:10 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1" returned: 0 in 0.819s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1" released by "delete_volume" :: held 1.763s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Created reservations ['571399a3-0734-44d2-b962-decc970bf5ad', '3642c79c-a7df-4a72-ab3e-2c41aeeb810f', '3c9d8502-dd7d-4971-8cac-402c6db65829', '0c66fc1a-24a2-46cc-9c6e-df33c96d91d2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:10 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf2b282b-0380-465f-ac66-2fa538efc6e2" returned: 0 in 0.852s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-quobyte-bf2b282b-0380-465f-ac66-2fa538efc6e2" released by "delete_volume" :: held 1.741s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Created reservations ['7d944b7d-6325-4722-bfc3-828fe3f3ab6b', '39db5ac6-47db-4c17-b866-b3d90cd68935', 'c40bd3f3-e47b-4746-b33c-497c4edc4428', 'b017cdce-023a-42d8-be04-95a441234561'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:10 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:10 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:10 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:10 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "cinder-0cdff2aa-fc85-4807-803c-80bcef696d61-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-0cdff2aa-fc85-4807-803c-80bcef696d61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "cinder-quobyte-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-quobyte-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "cinder-quobyte-0cdff2aa-fc85-4807-803c-80bcef696d61" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-quobyte-0cdff2aa-fc85-4807-803c-80bcef696d61" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Deleting offline snapshot 0cdff2aa-fc85-4807-803c-80bcef696d61 of volume a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] snapshot_file for this snap is: volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[70453534-a805-4fe2-b90b-fbcf3ea18a70]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:11 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 Jul 07 10:40:11 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:11 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.362s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Deleted volume successfully. Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (5f21aadd-ce99-47c9-9b97-1cb02b44ed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982b895c-e5ea-413f-9e31-0803d8ed27a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982b895c-e5ea-413f-9e31-0803d8ed27a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1175367965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55ef367-eff5-40d2-96df-fbf21e1c8db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:12Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90f33a-aeee-4706-98b9-c6844cf6684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90f33a-aeee-4706-98b9-c6844cf6684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5665b6c7-d525-48d0-98d2-0da64854c74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:12 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5665b6c7-d525-48d0-98d2-0da64854c74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55ef367-eff5-40d2-96df-fbf21e1c8db0', 'volume_name': 'volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558d3696-e35a-4415-8ae3-1db209b40b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558d3696-e35a-4415-8ae3-1db209b40b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bb9e41-b6db-486a-b0a1-ed0a6e8a22b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:12 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Volume b55ef367-eff5-40d2-96df-fbf21e1c8db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0', 'volume_size': 1} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1175367965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55ef367-eff5-40d2-96df-fbf21e1c8db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:12Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Creating volume b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:12 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.456s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c68a3a8d-d4ff-465c-a476-e373140e75c9 tempest-VolumesGetTest-1855081002 None] Lock "cinder-0f51cc30-09d3-47fd-adf1-7d5602aaf9c1-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Deleted volume successfully. Jul 07 10:40:12 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 1073741824 Jul 07 10:40:12 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-581a8274-78a5-4b52-952c-34eb87ce5167 tempest-CreateVolumesFromSourceVolumeTest-1953271103 None] Lock "cinder-bf2b282b-0380-465f-ac66-2fa538efc6e2-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:12 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61" returned: 0 in 1.045s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ab317-e547-4254-9a24-9fedb71c2eef]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:12 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce Jul 07 10:40:12 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:13 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 1073741824" returned: 0 in 1.141s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:13 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 Jul 07 10:40:13 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:13 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" returned: 0 in 1.012s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:13 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 Jul 07 10:40:13 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:14 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0" returned: 0 in 0.837s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bb9e41-b6db-486a-b0a1-ed0a6e8a22b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8970b076-46d1-464e-9435-feb5f34bca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:14 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Volume volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 (b55ef367-eff5-40d2-96df-fbf21e1c8db0): created successfully Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8970b076-46d1-464e-9435-feb5f34bca2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (5f21aadd-ce99-47c9-9b97-1cb02b44ed72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2129e2db-c2b3-434c-b6cb-7c07e1920214 tempest-VolumesGetTest-1855081002 None] Created volume successfully. Jul 07 10:40:14 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61" returned: 0 in 0.896s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:14 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61 Jul 07 10:40:14 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:15 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce.0cdff2aa-fc85-4807-803c-80bcef696d61" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-quobyte-0cdff2aa-fc85-4807-803c-80bcef696d61" released by "_delete_snapshot" :: held 3.956s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-quobyte-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" released by "delete_snapshot" :: held 4.018s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.quota [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Created reservations ['682956e1-09b9-4c5a-8bc7-7ab7959351e1', '4a4a214e-7e58-4a1c-8528-843744fa189e', '4bd2905c-227b-41b3-bd17-948c59c56b72', '1f57ed39-0b28-4ddf-8ff9-85d4698bf17a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:15 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Delete snapshot completed successfully. Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-e0b8f4c3-6f23-44b7-b053-917a80fd2d3a req-c543fbb3-9651-40eb-ab57-6d06296c770a tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-0cdff2aa-fc85-4807-803c-80bcef696d61-delete_snapshot" released by "delete_snapshot" :: held 4.241s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "cinder-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (3d4d44fe-3532-4bdb-878f-fed4c7acfd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1905ff8-170d-45cb-aa23-6781961920e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1905ff8-170d-45cb-aa23-6781961920e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-49815712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1b10dd-ea38-48d3-a918-1ae0cc770f16,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b55ef367-eff5-40d2-96df-fbf21e1c8db0,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:16Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769759b0-f983-4c98-8d0f-5797794e1091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769759b0-f983-4c98-8d0f-5797794e1091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552deb9f-cffd-4edf-b3f3-845622734fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552deb9f-cffd-4edf-b3f3-845622734fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd1b10dd-ea38-48d3-a918-1ae0cc770f16', 'volume_name': 'volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16', 'volume_size': 1, 'source_volid': 'b55ef367-eff5-40d2-96df-fbf21e1c8db0', 'source_volstatus': 'available'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610ada3b-54f2-451c-8379-d194ec4f22f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610ada3b-54f2-451c-8379-d194ec4f22f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e156e6-2d90-4176-9657-652294978152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:15 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Volume cd1b10dd-ea38-48d3-a918-1ae0cc770f16: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16', 'volume_size': 1, 'source_volid': 'b55ef367-eff5-40d2-96df-fbf21e1c8db0', 'source_volstatus': 'available'} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:15 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Cloning volume b55ef367-eff5-40d2-96df-fbf21e1c8db0 to volume cd1b10dd-ea38-48d3-a918-1ae0cc770f16 Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "cinder-quobyte-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-quobyte-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Creating offline snapshot 009bcebd-c322-4c17-a7cb-2035fde74645 of volume b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d00aec-ecbd-4827-9251-077f9314e149]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d62b47-3be8-47b8-937a-6961e994def1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:16 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce Jul 07 10:40:16 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:16 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 Jul 07 10:40:16 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:16 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0" returned: 0 in 0.868s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:16 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" returned: 0 in 0.919s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:16 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 1G Jul 07 10:40:16 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:16 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce Jul 07 10:40:16 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:17 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" returned: 0 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-quobyte-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce" released by "delete_volume" :: held 1.746s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG cinder.quota [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Created reservations ['813b035b-b8db-4567-82ee-3518305eab96', '7968b341-7e11-4d1c-8707-6dd1744d75a5', 'a86b2394-7553-49bc-a77c-a64a51dd46c8', '87078820-a75d-4e9b-b14e-3e021d73376a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:17 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 1G" returned: 0 in 0.958s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:17 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:17 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:17 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 Jul 07 10:40:17 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:18 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.858s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:18 devstack cinder-volume[87208]: DEBUG cinder.manager [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:18 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Deleted volume successfully. Jul 07 10:40:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-60a36664-f64c-442b-b31b-482ebbb2b1ba req-0323c1e5-1931-4c3f-8490-d820c88791da tempest-VolumesSnapshotsTestJSON-1299839417 None] Lock "cinder-a6bd4c39-8ec5-45c0-b04b-73c64b1ab4ce-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:18 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645" returned: 0 in 0.944s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:18 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 is being set with open permissions: ugo+rw Jul 07 10:40:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:18 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 Jul 07 10:40:18 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:19 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645" returned: 0 in 0.759s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:19 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=195,cinder:SELECT=138,cinder:DELETE=15,cinder:INSERT=38 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:40:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:19 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.info Jul 07 10:40:19 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:20 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.info" returned: 0 in 0.849s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:20 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.info is being set with open permissions: ugo+rw Jul 07 10:40:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:20 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.info Jul 07 10:40:20 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:21 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.info" returned: 0 in 1.091s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] snapshot: 009bcebd-c322-4c17-a7cb-2035fde74645, volume: cd1b10dd-ea38-48d3-a918-1ae0cc770f16, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c64122-4184-449d-8b42-24ff52f3b8b4]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:21 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 Jul 07 10:40:21 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:22 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645" returned: 0 in 1.270s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:40:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:40:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:40:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f14fa0c-bac5-4785-b90d-213506d6d4a6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:23 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 Jul 07 10:40:23 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:23 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:23 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:23 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0" returned: 0 in 0.874s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:40:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:23 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 Jul 07 10:40:23 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:24 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.905s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:40:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 8 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:40:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:40:29 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=99,cinder:DELETE=8,cinder:SELECT=74,cinder:INSERT=32 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:40:31 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" returned: 0 in 7.245s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9146bb32-e1bb-46ef-8b0b-9151c84eb8c2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:31 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 Jul 07 10:40:31 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (bcd0c62a-bfaf-41a2-ad90-d0008b0cd273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c712949-c6a2-4fc9-94fb-715020945af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c712949-c6a2-4fc9-94fb-715020945af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871940105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:31Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052da6ee-9025-4cef-b63f-13e5a3cedfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052da6ee-9025-4cef-b63f-13e5a3cedfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b164aaac-6e27-446d-bdaf-8681b7386683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b164aaac-6e27-446d-bdaf-8681b7386683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7', 'volume_name': 'volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48dc9f0d-2375-4f46-a169-0b3a894c88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48dc9f0d-2375-4f46-a169-0b3a894c88de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac520e-32f1-43e8-95ba-d1afcbd2f52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:31 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Volume b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7', 'volume_size': 1} Jul 07 10:40:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:32 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0" returned: 0 in 1.174s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:40:32 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Converted 1024.00 MB image at 141.28 MB/s Jul 07 10:40:32 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 is being set with open permissions: ugo+rw Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:32 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 Jul 07 10:40:32 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-14a1d7dd-5ac9-4985-9c1d-da3d2da40513 tempest-BackendsCapabilitiesAdminTestsJSON-378211811 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87208) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 10:40:32 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" returned: 0 in 0.661s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" released by "_copy_volume_from_snapshot" :: held 11.356s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-009bcebd-c322-4c17-a7cb-2035fde74645" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-009bcebd-c322-4c17-a7cb-2035fde74645" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Deleting offline snapshot 009bcebd-c322-4c17-a7cb-2035fde74645 of volume b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:40:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] snapshot_file for this snap is: volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:40:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a751f6-2666-4e56-b836-16eaa586c7a6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:33 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 Jul 07 10:40:33 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1aacba46-4daf-461a-b81f-280aaffe00ba tempest-BackendsCapabilitiesAdminTestsJSON-378211811 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87208) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 10:40:33 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645" returned: 0 in 0.829s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:40:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85d961a-dda1-4bb0-bc35-30203423fc4a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:34 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 Jul 07 10:40:34 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:34 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0" returned: 0 in 0.977s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:34 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 Jul 07 10:40:34 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:35 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645" returned: 0 in 0.955s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:35 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645 Jul 07 10:40:35 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:36 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0.009bcebd-c322-4c17-a7cb-2035fde74645" returned: 0 in 0.798s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-009bcebd-c322-4c17-a7cb-2035fde74645" released by "_delete_snapshot" :: held 3.687s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.796s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871940105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:31Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Creating volume b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:36 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e156e6-2d90-4176-9657-652294978152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16', 'volume_size': 1, 'source_volid': 'b55ef367-eff5-40d2-96df-fbf21e1c8db0', 'source_volstatus': 'available'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e4cb74-2b5f-4c47-b90f-10ade9b6165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:36 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 1073741824 Jul 07 10:40:36 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Volume volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 (cd1b10dd-ea38-48d3-a918-1ae0cc770f16): created successfully Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e4cb74-2b5f-4c47-b90f-10ade9b6165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (3d4d44fe-3532-4bdb-878f-fed4c7acfd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-55081064-af68-4093-8d85-45615221dece tempest-VolumesGetTest-1855081002 None] Created volume successfully. Jul 07 10:40:37 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:37 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (3977cc5c-9d1f-43ec-9b3d-557af3af3564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577e412e-8652-415a-bf1a-0baad2441ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 1073741824" returned: 0 in 1.218s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577e412e-8652-415a-bf1a-0baad2441ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1646224103',display_name='tempest-VolumesGetTest-Volume-1849815932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4d5699-f63b-4471-8d1f-b8f4ea945546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:38Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6213874-75d4-4f81-ad59-fc8169e08308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6213874-75d4-4f81-ad59-fc8169e08308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d17ca15-1a39-4a78-824e-4688c4067977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d17ca15-1a39-4a78-824e-4688c4067977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4d5699-f63b-4471-8d1f-b8f4ea945546', 'volume_name': 'volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4fb99d-610e-4905-8bac-2d371fc1dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4fb99d-610e-4905-8bac-2d371fc1dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfb0e64-e334-455b-afc8-b498073d7631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Volume 7c4d5699-f63b-4471-8d1f-b8f4ea945546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546', 'volume_size': 1} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:38 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 Jul 07 10:40:38 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:38 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7" returned: 0 in 0.700s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1646224103',display_name='tempest-VolumesGetTest-Volume-1849815932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4d5699-f63b-4471-8d1f-b8f4ea945546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:38Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Creating volume 7c4d5699-f63b-4471-8d1f-b8f4ea945546 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:38 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac520e-32f1-43e8-95ba-d1afcbd2f52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1194607-696b-4adc-8414-32e1df290ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:38 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 1073741824 Jul 07 10:40:38 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Volume volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 (b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7): created successfully Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1194607-696b-4adc-8414-32e1df290ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (bcd0c62a-bfaf-41a2-ad90-d0008b0cd273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-50b549d2-80dd-489e-8b22-9acbe649a4e2 tempest-ProjectReaderTests-968473035 None] Created volume successfully. Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Lock "cinder-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-quobyte-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f08e2a-bdfc-4123-be0c-018c7e50729e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:39 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 Jul 07 10:40:39 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:39 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 1073741824" returned: 0 in 0.997s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:39 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 Jul 07 10:40:39 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:40 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7" returned: 0 in 0.862s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:40 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7 Jul 07 10:40:40 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:40 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546" returned: 0 in 0.767s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfb0e64-e334-455b-afc8-b498073d7631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654a31c8-0671-4b31-acd7-f8237f38a0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Volume volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 (7c4d5699-f63b-4471-8d1f-b8f4ea945546): created successfully Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654a31c8-0671-4b31-acd7-f8237f38a0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (3977cc5c-9d1f-43ec-9b3d-557af3af3564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-413c68a5-8a41-4d90-a83f-493ce512da5d tempest-VolumesGetTest-1855081002 None] Created volume successfully. Jul 07 10:40:41 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7" released by "delete_volume" :: held 1.712s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Created reservations ['6823d447-5fd6-432a-8b06-555d66057e61', '6e0ae75f-428b-4e4d-bbd9-027b09fbb999', '13901b51-48d3-45f0-acbb-58be2018bee6', '77fb526f-cc03-4875-bfbd-4cdf53eb50cc'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-7c4d5699-f63b-4471-8d1f-b8f4ea945546-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:41 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:41 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Lock "cinder-7c4d5699-f63b-4471-8d1f-b8f4ea945546-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-7c4d5699-f63b-4471-8d1f-b8f4ea945546" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-7c4d5699-f63b-4471-8d1f-b8f4ea945546" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d54a63-bfc7-4ab0-ad92-7860da94ee73]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:41 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 Jul 07 10:40:41 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (826dc3b4-70a1-45a0-bdc3-bd588596611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3624c1e6-8ee1-4782-82af-e8f3c5c59229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3624c1e6-8ee1-4782-82af-e8f3c5c59229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529064687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96c8de6-ec38-4427-995e-10778d36702e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:42Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cff84b-f648-491e-9396-aed98c9c27f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cff84b-f648-491e-9396-aed98c9c27f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71c3a91-154a-4638-97b8-0b24bfa4d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71c3a91-154a-4638-97b8-0b24bfa4d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96c8de6-ec38-4427-995e-10778d36702e', 'volume_name': 'volume-e96c8de6-ec38-4427-995e-10778d36702e', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa5e55f-7095-4fc5-8b9b-5a125b2350aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa5e55f-7095-4fc5-8b9b-5a125b2350aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f53db6-f946-428c-81c4-f47cb33be44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:42 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Volume e96c8de6-ec38-4427-995e-10778d36702e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96c8de6-ec38-4427-995e-10778d36702e', 'volume_size': 1} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529064687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96c8de6-ec38-4427-995e-10778d36702e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:42Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Creating volume e96c8de6-ec38-4427-995e-10778d36702e {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:42 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:42 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:42 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e 1073741824 Jul 07 10:40:42 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.400s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Deleted volume successfully. Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8f211d6-c15e-438f-921f-40cc7fd1085b tempest-ProjectReaderTests-968473035 None] Lock "cinder-b273ea60-4234-46c0-b9ba-8dcc7f9f9cb7-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:42 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546" returned: 0 in 1.375s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:42 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546 Jul 07 10:40:42 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:43 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e 1073741824" returned: 0 in 1.095s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:43 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7c4d5699-f63b-4471-8d1f-b8f4ea945546" returned: 0 in 0.873s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-7c4d5699-f63b-4471-8d1f-b8f4ea945546" released by "delete_volume" :: held 2.318s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:43 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e Jul 07 10:40:43 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Created reservations ['9c3e04d1-acbf-46a8-854c-e73db73ed737', 'ab571ec5-0ed0-466c-89ed-5a75c0700aec', '5468192e-805c-4075-b4c1-1cc6c63b1945', 'fbc6a12b-ba22-40e5-ac91-8df052df7f9b'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:43 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:43 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:44 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e" returned: 0 in 0.676s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f53db6-f946-428c-81c4-f47cb33be44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96c8de6-ec38-4427-995e-10778d36702e', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f6910f-bac4-4b11-8d9d-7cccdcdff2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:44 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Volume volume-e96c8de6-ec38-4427-995e-10778d36702e (e96c8de6-ec38-4427-995e-10778d36702e): created successfully Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f6910f-bac4-4b11-8d9d-7cccdcdff2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (826dc3b4-70a1-45a0-bdc3-bd588596611a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:44 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-daad5c93-f95c-47be-8b4c-4a04d2ca260b tempest-ProjectReaderTests-968473035 None] Created volume successfully. Jul 07 10:40:44 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.681s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:44 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Deleted volume successfully. Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e997af52-baaf-40ad-9f4f-295817dd0a05 tempest-VolumesGetTest-1855081002 None] Lock "cinder-7c4d5699-f63b-4471-8d1f-b8f4ea945546-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-cd1b10dd-ea38-48d3-a918-1ae0cc770f16-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Lock "cinder-cd1b10dd-ea38-48d3-a918-1ae0cc770f16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a92e714-196d-4820-a315-0895a8c1d0ea]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:44 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 Jul 07 10:40:44 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:45 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" returned: 0 in 0.769s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:45 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16 Jul 07 10:40:45 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-e96c8de6-ec38-4427-995e-10778d36702e-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Lock "cinder-e96c8de6-ec38-4427-995e-10778d36702e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-quobyte-e96c8de6-ec38-4427-995e-10778d36702e" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-e96c8de6-ec38-4427-995e-10778d36702e" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f740314-79ab-48b4-a909-b56a2a48259c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:45 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e Jul 07 10:40:45 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:46 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" returned: 0 in 0.693s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-cd1b10dd-ea38-48d3-a918-1ae0cc770f16" released by "delete_volume" :: held 1.518s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Created reservations ['2249977b-8d0a-44f4-aff7-3314dc5e908f', 'c36c7821-1337-40cb-ba45-daf66676d955', '53ef9496-265a-45e9-a803-2ae9cff0974a', 'eb05a5fb-899f-47a2-bbd2-2325372febd7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:46 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:46 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Flow 'volume_create_manager' (53b8a2f9-b6d0-45da-95d1-121910686de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875fa872-03eb-48d8-8351-19d15948926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875fa872-03eb-48d8-8351-19d15948926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-724310300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb91f082-c9a6-4ed4-a63f-921904cbfa8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548db0d665bd4b34aef08095f62a87c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:46Z,use_quota=True,user_id='b2f04206b3be4555997ea5764eeb9116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7dfaff5-5b43-46a5-844a-caae082687c0),volume_type_id=b7dfaff5-5b43-46a5-844a-caae082687c0)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b4bac8-8ed1-469e-b620-44f9444dd737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b4bac8-8ed1-469e-b620-44f9444dd737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147a1194-68fa-4792-bdac-24b6cec2864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147a1194-68fa-4792-bdac-24b6cec2864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb91f082-c9a6-4ed4-a63f-921904cbfa8b', 'volume_name': 'volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487bdd61-1605-4f94-8b14-c5af9e4cdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487bdd61-1605-4f94-8b14-c5af9e4cdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ee6e03-fe90-40d0-9ed6-9c6773c0c043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:46 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Volume eb91f082-c9a6-4ed4-a63f-921904cbfa8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b', 'volume_size': 1} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-724310300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb91f082-c9a6-4ed4-a63f-921904cbfa8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548db0d665bd4b34aef08095f62a87c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:46Z,use_quota=True,user_id='b2f04206b3be4555997ea5764eeb9116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7dfaff5-5b43-46a5-844a-caae082687c0),volume_type_id=b7dfaff5-5b43-46a5-844a-caae082687c0)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Creating volume eb91f082-c9a6-4ed4-a63f-921904cbfa8b {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:46 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:46 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e" returned: 0 in 0.808s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:46 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b 1073741824 Jul 07 10:40:46 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:46 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e Jul 07 10:40:46 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-b55ef367-eff5-40d2-96df-fbf21e1c8db0-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Lock "cinder-b55ef367-eff5-40d2-96df-fbf21e1c8db0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:47 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.688s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Deleted volume successfully. Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-b55ef367-eff5-40d2-96df-fbf21e1c8db0" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-45ec0345-cfb2-4a18-9219-97b00b349ee2 tempest-VolumesGetTest-1855081002 None] Lock "cinder-cd1b10dd-ea38-48d3-a918-1ae0cc770f16-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-b55ef367-eff5-40d2-96df-fbf21e1c8db0" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a16d7c-d185-45c9-8bac-e1d57960bea9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:47 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e96c8de6-ec38-4427-995e-10778d36702e" returned: 0 in 0.715s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-e96c8de6-ec38-4427-995e-10778d36702e" released by "delete_volume" :: held 1.560s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:47 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 Jul 07 10:40:47 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Created reservations ['60662a7f-e061-4dc2-a3bd-70804ea4c61a', 'f32a98b4-37fc-442a-904c-1adc772b2c15', '79896168-59c7-44b0-a24f-db83f58b6c97', '04011838-617b-4fb0-82ce-7d9443b44c76'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:47 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:47 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:47 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b 1073741824" returned: 0 in 0.936s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:47 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b Jul 07 10:40:47 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:48 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0" returned: 0 in 0.827s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:48 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0 Jul 07 10:40:48 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:48 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.682s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Deleted volume successfully. Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e3f1597b-4308-4146-9d50-729587d41877 tempest-ProjectReaderTests-968473035 None] Lock "cinder-e96c8de6-ec38-4427-995e-10778d36702e-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:48 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b" returned: 0 in 0.810s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ee6e03-fe90-40d0-9ed6-9c6773c0c043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496c1a7a-7ddb-4f97-9898-77ddc73af96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Volume volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b (eb91f082-c9a6-4ed4-a63f-921904cbfa8b): created successfully Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496c1a7a-7ddb-4f97-9898-77ddc73af96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Flow 'volume_create_manager' (53b8a2f9-b6d0-45da-95d1-121910686de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e9dfab64-3c5f-4a43-9ba5-d8b7d66d191e tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Created volume successfully. Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (ebc8df90-0b61-4d18-981b-e465812189e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214cdf6a-9221-43cc-ae80-4fbb2c6d67c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214cdf6a-9221-43cc-ae80-4fbb2c6d67c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567542423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e98404-7c1d-43b5-b6c4-df100c8fa894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:48Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6b1249-f841-4b4e-ba0b-c8a08d2bb409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6b1249-f841-4b4e-ba0b-c8a08d2bb409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f68569-2115-4185-86cf-faa330541131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f68569-2115-4185-86cf-faa330541131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e98404-7c1d-43b5-b6c4-df100c8fa894', 'volume_name': 'volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81859764-9e55-4014-946e-d334cd1c79cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81859764-9e55-4014-946e-d334cd1c79cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea1a565-88cf-4dbf-813e-bd2ac97ebdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Volume a4e98404-7c1d-43b5-b6c4-df100c8fa894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894', 'volume_size': 1} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567542423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e98404-7c1d-43b5-b6c4-df100c8fa894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:48Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Creating volume a4e98404-7c1d-43b5-b6c4-df100c8fa894 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:48 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:48 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 1073741824 Jul 07 10:40:48 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:48 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b55ef367-eff5-40d2-96df-fbf21e1c8db0" returned: 0 in 0.873s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-b55ef367-eff5-40d2-96df-fbf21e1c8db0" released by "delete_volume" :: held 1.789s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Created reservations ['e85f9b26-ecc7-45ce-8844-163b363f3158', '4aff3a55-67d5-4ac2-8947-3ac43d0130be', 'f65108ba-3a00-4fdd-b544-d6241987ddfd', 'c7d7a9d0-d256-46a7-a894-1ee729e9a43a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:49 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:49 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:49 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:49 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:49 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 1073741824" returned: 0 in 1.237s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:49 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 Jul 07 10:40:49 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:50 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.918s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8f854bbc-5eaf-4d43-a824-9df5e386b52d tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Retype volume completed successfully. Jul 07 10:40:50 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.086s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Deleted volume successfully. Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477a8d6b-53c2-4766-96b6-752da47d90f7 tempest-VolumesGetTest-1855081002 None] Lock "cinder-b55ef367-eff5-40d2-96df-fbf21e1c8db0-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Acquiring lock "cinder-eb91f082-c9a6-4ed4-a63f-921904cbfa8b-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "cinder-eb91f082-c9a6-4ed4-a63f-921904cbfa8b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Acquiring lock "cinder-quobyte-eb91f082-c9a6-4ed4-a63f-921904cbfa8b" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "cinder-quobyte-eb91f082-c9a6-4ed4-a63f-921904cbfa8b" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[79135bbf-0e45-4574-ac5f-d5db6f3e91fd]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:50 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b Jul 07 10:40:50 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:50 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894" returned: 0 in 0.943s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (cd70b10a-2434-41aa-b4ec-153f203c3d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f67695b-a413-4c82-82b8-d74d44f7df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea1a565-88cf-4dbf-813e-bd2ac97ebdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf08a997-5a2e-4e10-8e91-aa9ea4e9cd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f67695b-a413-4c82-82b8-d74d44f7df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1254310419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06c3103-db82-439d-a702-e365dfa5a29a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:51Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74c4778-de55-4fa7-a451-996eb55e5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74c4778-de55-4fa7-a451-996eb55e5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3a7310-28c6-419f-987f-4bae66711450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:40:50 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Volume volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 (a4e98404-7c1d-43b5-b6c4-df100c8fa894): created successfully Jul 07 10:40:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf08a997-5a2e-4e10-8e91-aa9ea4e9cd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (ebc8df90-0b61-4d18-981b-e465812189e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-514398d3-a2ec-4000-ad7a-7afcea0d8ada tempest-ProjectReaderTests-968473035 None] Created volume successfully. Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3a7310-28c6-419f-987f-4bae66711450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c06c3103-db82-439d-a702-e365dfa5a29a', 'volume_name': 'volume-c06c3103-db82-439d-a702-e365dfa5a29a', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3553aae-4ef7-470d-88b1-03c0b2f30eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3553aae-4ef7-470d-88b1-03c0b2f30eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaaed0f-9e87-4b35-90fe-4cc104d2d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:51 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Volume c06c3103-db82-439d-a702-e365dfa5a29a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c06c3103-db82-439d-a702-e365dfa5a29a', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Trying to clone c06c3103-db82-439d-a702-e365dfa5a29a from image d50a09c8-834c-44f1-b638-afb2a382f8e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:40:51 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b" returned: 0 in 0.863s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:51 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b Jul 07 10:40:51 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:40:51 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Image download 20.69 MB at 20.69 MB/s Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4949c-7817-4bfa-9331-4580676c4e9b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:51 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-a4e98404-7c1d-43b5-b6c4-df100c8fa894-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:51 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Lock "cinder-a4e98404-7c1d-43b5-b6c4-df100c8fa894-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-quobyte-a4e98404-7c1d-43b5-b6c4-df100c8fa894" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-a4e98404-7c1d-43b5-b6c4-df100c8fa894" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b75c6-8304-43c8-9f05-f4e15e73cf61]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:52 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 Jul 07 10:40:52 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:52 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eb91f082-c9a6-4ed4-a63f-921904cbfa8b" returned: 0 in 0.709s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "cinder-quobyte-eb91f082-c9a6-4ed4-a63f-921904cbfa8b" released by "delete_volume" :: held 1.634s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:52 devstack cinder-volume[87208]: WARNING cinder.quota [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:40:52 devstack cinder-volume[87208]: WARNING cinder.quota [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Created reservations ['61c95287-3b5a-4291-b6aa-a47cb05b4e12', '63854d8b-7de4-495b-86bc-b9e254c35aeb', '44dc59c1-c85e-4bd2-8baa-903e532f4fa3', '04026717-4745-4a19-8ca2-d39b09912e5c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:52 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:52 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:52 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD" returned: 0 in 0.798s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 is fetched for user 5858cb34328143ebb40041f8ef4b8fbf. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0417a5b-e051-4320-aa51-75e153b83ffa]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:52 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD Jul 07 10:40:52 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:52 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894" returned: 0 in 0.827s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:52 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894 Jul 07 10:40:52 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:53 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.695s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Deleted volume successfully. Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bac87f64-45ed-4dc8-a946-dd4d3f386423 tempest-VolumeRetypeWithoutMigrationTest-239094048 None] Lock "cinder-eb91f082-c9a6-4ed4-a63f-921904cbfa8b-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:53 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD" returned: 0 in 0.835s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1254310419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06c3103-db82-439d-a702-e365dfa5a29a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:51Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Creating volume c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:53 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:53 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a 1073741824 Jul 07 10:40:53 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:53 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a4e98404-7c1d-43b5-b6c4-df100c8fa894" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-a4e98404-7c1d-43b5-b6c4-df100c8fa894" released by "delete_volume" :: held 1.642s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Created reservations ['c384ea49-29d6-408a-9670-68000ed37d3d', 'd089fd50-f79b-4004-8d77-6f4c6050fff2', 'a93dd599-0f58-49c8-b003-f9cc38470591', '5971bf5d-dce9-4684-9940-9aab061191a7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:53 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:40:53 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:54 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a 1073741824" returned: 0 in 0.979s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:54 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a Jul 07 10:40:54 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:54 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.778s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:40:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Deleted volume successfully. Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-604c0b3d-745d-44c1-a6f2-2b53bc0582d5 tempest-ProjectReaderTests-968473035 None] Lock "cinder-a4e98404-7c1d-43b5-b6c4-df100c8fa894-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (a1f89a46-8d71-492e-bac3-7bfa84d5c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64208075-a1fd-49b0-8a42-fa18e913fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64208075-a1fd-49b0-8a42-fa18e913fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896328028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861d22b1-c498-42bf-9edc-3c04ef1f8046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:55Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5cba6b-daa7-45c2-a96a-a39bd107b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5cba6b-daa7-45c2-a96a-a39bd107b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b10f44-21c5-4505-a95f-23561bebf454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b10f44-21c5-4505-a95f-23561bebf454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861d22b1-c498-42bf-9edc-3c04ef1f8046', 'volume_name': 'volume-861d22b1-c498-42bf-9edc-3c04ef1f8046', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a0c53d-7be5-4b6f-80c1-46319d423fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a0c53d-7be5-4b6f-80c1-46319d423fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f64c73-6d17-4319-a1c4-0e42a4e8ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:54 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Volume 861d22b1-c498-42bf-9edc-3c04ef1f8046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861d22b1-c498-42bf-9edc-3c04ef1f8046', 'volume_size': 1} Jul 07 10:40:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:55 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a" returned: 0 in 0.852s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896328028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861d22b1-c498-42bf-9edc-3c04ef1f8046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66768784acb04fda98e7d0ab87b2942e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:55Z,use_quota=True,user_id='cc0112f96bc24ab182e889e7a513985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Creating volume 861d22b1-c498-42bf-9edc-3c04ef1f8046 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:55 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:55 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 1073741824 Jul 07 10:40:55 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Flow 'volume_create_manager' (78b7ba87-4923-4f4f-be25-7aa25e5f79b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84dd35f-3081-4563-9444-59b9b98833de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Attempting download of d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume c06c3103-db82-439d-a702-e365dfa5a29a. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84dd35f-3081-4563-9444-59b9b98833de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1530430516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a6e929-fac8-429e-a99d-2aa871f3064a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43de7362d4634a45bda147ee65642cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:55Z,use_quota=True,user_id='603a2b5f12a440808754ef5fccab2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080880a1-ddc0-4b99-bf95-d8dccaac1bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080880a1-ddc0-4b99-bf95-d8dccaac1bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e597e372-0098-4ed9-8dd3-a028d3f989a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e597e372-0098-4ed9-8dd3-a028d3f989a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a6e929-fac8-429e-a99d-2aa871f3064a', 'volume_name': 'volume-d0a6e929-fac8-429e-a99d-2aa871f3064a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543fd71c-f1f9-44f5-aa84-75d99b07a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543fd71c-f1f9-44f5-aa84-75d99b07a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dc186b-cba1-4a16-a033-d4b550c27c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Volume d0a6e929-fac8-429e-a99d-2aa871f3064a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a6e929-fac8-429e-a99d-2aa871f3064a', 'volume_size': 1} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e34d6-327c-43bc-b52c-2d69641032ca]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_4rhe3712 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:55 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_4rhe3712 Jul 07 10:40:55 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:56 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 1073741824" returned: 0 in 0.941s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:56 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_4rhe3712" returned: 0 in 0.825s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_4rhe3712 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:56 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 Jul 07 10:40:56 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:56 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_4rhe3712 Jul 07 10:40:56 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:57 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1530430516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a6e929-fac8-429e-a99d-2aa871f3064a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43de7362d4634a45bda147ee65642cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:40:55Z,use_quota=True,user_id='603a2b5f12a440808754ef5fccab2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Creating volume d0a6e929-fac8-429e-a99d-2aa871f3064a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:40:57 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:57 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a 1073741824 Jul 07 10:40:57 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f64c73-6d17-4319-a1c4-0e42a4e8ab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861d22b1-c498-42bf-9edc-3c04ef1f8046', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eea7b2c-7527-4dc2-8035-2cb1dd71a070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Volume volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 (861d22b1-c498-42bf-9edc-3c04ef1f8046): created successfully Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eea7b2c-7527-4dc2-8035-2cb1dd71a070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Flow 'volume_create_manager' (a1f89a46-8d71-492e-bac3-7bfa84d5c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6e4489ea-0cf6-472b-8023-2edb83523a8a tempest-ProjectReaderTests-968473035 None] Created volume successfully. Jul 07 10:40:57 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_4rhe3712" returned: 1 in 0.918s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_4rhe3712' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f3c450-c55e-454c-a955-5a6d2a259bc5]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:57 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD Jul 07 10:40:57 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-861d22b1-c498-42bf-9edc-3c04ef1f8046-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Lock "cinder-861d22b1-c498-42bf-9edc-3c04ef1f8046-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Acquiring lock "cinder-quobyte-861d22b1-c498-42bf-9edc-3c04ef1f8046" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-861d22b1-c498-42bf-9edc-3c04ef1f8046" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2880e36-610b-4a34-b212-e46c54483d8d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:58 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD" returned: 0 in 0.859s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] d50a09c8-834c-44f1-b638-afb2a382f8e6 was qcow2, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:58 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a 1073741824" returned: 0 in 1.046s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:58 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a Jul 07 10:40:58 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:58 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 Jul 07 10:40:58 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:58 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a Jul 07 10:40:58 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:59 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a" returned: 0 in 0.762s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:40:59 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dc186b-cba1-4a16-a033-d4b550c27c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a6e929-fac8-429e-a99d-2aa871f3064a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55aa125a-488a-4031-b6b7-eebfe178d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046" returned: 0 in 0.937s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:40:59 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Volume volume-d0a6e929-fac8-429e-a99d-2aa871f3064a (d0a6e929-fac8-429e-a99d-2aa871f3064a): created successfully Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55aa125a-488a-4031-b6b7-eebfe178d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:40:59 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046 Jul 07 10:40:59 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Flow 'volume_create_manager' (78b7ba87-4923-4f4f-be25-7aa25e5f79b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:40:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6af4f922-d716-4053-866d-b1d4992d1620 tempest-AttachVolumeTestJSON-1667183289 None] Created volume successfully. Jul 07 10:40:59 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-861d22b1-c498-42bf-9edc-3c04ef1f8046" returned: 0 in 0.784s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Lock "cinder-quobyte-861d22b1-c498-42bf-9edc-3c04ef1f8046" released by "delete_volume" :: held 1.775s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:40:59 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Created reservations ['79314d78-d828-4918-a732-fdedd2d2b93f', '291769fb-4ab4-4850-9586-6f593e1d20a3', 'da9a7023-7a07-492a-9de8-2cbed853a77c', 'd2dbb8b3-ade3-4b33-9003-92c6ae0b3fec'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:00 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:41:00 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:00 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a" returned: 0 in 2.469s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6__ay1vmi_devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:41:00 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Converted 112.00 MB image at 45.32 MB/s Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:00 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a 1G Jul 07 10:41:00 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:00 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.871s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:41:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Deleted volume successfully. Jul 07 10:41:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82164bf8-e74b-4f96-b13b-6fb8a3d600c3 tempest-ProjectReaderTests-968473035 None] Lock "cinder-861d22b1-c498-42bf-9edc-3c04ef1f8046-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:01 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a 1G" returned: 0 in 0.883s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:01 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf3dece-5d95-4739-bbdd-b65e8f804d41]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:01 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a Jul 07 10:41:01 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:02 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a" returned: 0 in 0.932s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:02 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a Jul 07 10:41:02 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-870e8183-4175-46e8-b3c6-94166b81944c req-5d4ce8ab-61a0-434c-8e17-2794b46cfa56 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-870e8183-4175-46e8-b3c6-94166b81944c req-5d4ce8ab-61a0-434c-8e17-2794b46cfa56 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffdf4e5-3774-4af6-98c5-81a57e4e4566]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-870e8183-4175-46e8-b3c6-94166b81944c req-5d4ce8ab-61a0-434c-8e17-2794b46cfa56 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:03 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a" returned: 1 in 0.860s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Downloaded image d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume c06c3103-db82-439d-a702-e365dfa5a29a successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 for user 5858cb34328143ebb40041f8ef4b8fbf is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Marking volume c06c3103-db82-439d-a702-e365dfa5a29a as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Copying metadata from image d50a09c8-834c-44f1-b638-afb2a382f8e6 to c06c3103-db82-439d-a702-e365dfa5a29a. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Creating volume glance metadata for volume c06c3103-db82-439d-a702-e365dfa5a29a backed by image d50a09c8-834c-44f1-b638-afb2a382f8e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:41:03 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a Jul 07 10:41:03 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaaed0f-9e87-4b35-90fe-4cc104d2d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06c3103-db82-439d-a702-e365dfa5a29a', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6864be-b4b9-428d-b5a7-67f4c2e1517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:03 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Volume volume-c06c3103-db82-439d-a702-e365dfa5a29a (c06c3103-db82-439d-a702-e365dfa5a29a): created successfully Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6864be-b4b9-428d-b5a7-67f4c2e1517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (cd70b10a-2434-41aa-b4ec-153f203c3d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-03fc5f81-f309-46cf-9071-3f19118e16e6 tempest-VolumesGetTest-1855081002 None] Created volume successfully. Jul 07 10:41:04 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-870e8183-4175-46e8-b3c6-94166b81944c req-5d4ce8ab-61a0-434c-8e17-2794b46cfa56 tempest-AttachVolumeTestJSON-1667183289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a" returned: 0 in 1.064s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-870e8183-4175-46e8-b3c6-94166b81944c req-5d4ce8ab-61a0-434c-8e17-2794b46cfa56 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.086s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-870e8183-4175-46e8-b3c6-94166b81944c req-5d4ce8ab-61a0-434c-8e17-2794b46cfa56 tempest-AttachVolumeTestJSON-1667183289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-d0a6e929-fac8-429e-a99d-2aa871f3064a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74ed8647-7437-4a5b-a621-c5df0a398793', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:41:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-870e8183-4175-46e8-b3c6-94166b81944c req-5d4ce8ab-61a0-434c-8e17-2794b46cfa56 tempest-AttachVolumeTestJSON-1667183289 None] attachment_update completed successfully. Jul 07 10:41:04 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:41:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (8bead402-d195-4841-9f62-71046297f15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e946d-bcab-44ad-b7b5-a0aa8e7bce02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e946d-bcab-44ad-b7b5-a0aa8e7bce02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1106943532',display_name='tempest-VolumesGetTest-Volume-1838496189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61564daf-d00e-4056-8194-b18d01feccc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:05Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0c62ce-ae50-4339-a09e-7a567f52a46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0c62ce-ae50-4339-a09e-7a567f52a46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa16638d-2f81-446b-b1de-0158cb859eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa16638d-2f81-446b-b1de-0158cb859eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61564daf-d00e-4056-8194-b18d01feccc5', 'volume_name': 'volume-61564daf-d00e-4056-8194-b18d01feccc5', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e55112a-1458-4c79-9c50-39411d02ee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e55112a-1458-4c79-9c50-39411d02ee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12725a07-675e-400d-82ac-3a58eba322c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:05 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Volume 61564daf-d00e-4056-8194-b18d01feccc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61564daf-d00e-4056-8194-b18d01feccc5', 'volume_size': 1} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1106943532',display_name='tempest-VolumesGetTest-Volume-1838496189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61564daf-d00e-4056-8194-b18d01feccc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f44f4acdce4236a62e672834f195b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:05Z,use_quota=True,user_id='5858cb34328143ebb40041f8ef4b8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Creating volume 61564daf-d00e-4056-8194-b18d01feccc5 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:41:05 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:41:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:05 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 1073741824 Jul 07 10:41:05 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:06 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 1073741824" returned: 0 in 1.118s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:06 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 Jul 07 10:41:06 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:06 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5" returned: 0 in 0.717s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:41:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12725a07-675e-400d-82ac-3a58eba322c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61564daf-d00e-4056-8194-b18d01feccc5', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2bd261-2b84-429e-8014-1f9eb908d5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:07 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Volume volume-61564daf-d00e-4056-8194-b18d01feccc5 (61564daf-d00e-4056-8194-b18d01feccc5): created successfully Jul 07 10:41:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2bd261-2b84-429e-8014-1f9eb908d5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Flow 'volume_create_manager' (8bead402-d195-4841-9f62-71046297f15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0bb97fad-82a9-4dfb-8121-9cea67983ce0 tempest-VolumesGetTest-1855081002 None] Created volume successfully. Jul 07 10:41:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-61564daf-d00e-4056-8194-b18d01feccc5-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Lock "cinder-61564daf-d00e-4056-8194-b18d01feccc5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-61564daf-d00e-4056-8194-b18d01feccc5" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-61564daf-d00e-4056-8194-b18d01feccc5" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde43752-18c8-4536-b348-aa32bded60db]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:08 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 Jul 07 10:41:08 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:09 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5" returned: 0 in 0.897s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:09 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5 Jul 07 10:41:09 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:10 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-61564daf-d00e-4056-8194-b18d01feccc5" returned: 0 in 0.893s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-61564daf-d00e-4056-8194-b18d01feccc5" released by "delete_volume" :: held 1.858s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Created reservations ['2aa69512-5428-4ac8-8505-272b858b4086', '8a973a8c-5ea2-409b-9b70-fcbc872d6ee4', '32eacc3c-60ee-45bf-9778-a103287f3408', 'be0f542a-5c61-44bf-b8d6-f5f714c33825'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:10 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:41:10 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Flow 'volume_create_manager' (bbc8f796-92df-4a76-99b1-d044af74bbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42d059e-8dfa-43aa-afdd-64aedcb670a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42d059e-8dfa-43aa-afdd-64aedcb670a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-963984434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871b1fda-bb4b-4ea7-b235-be4569936131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43de7362d4634a45bda147ee65642cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:10Z,use_quota=True,user_id='603a2b5f12a440808754ef5fccab2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1588634e-fee5-4c40-94e3-d1756b51ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1588634e-fee5-4c40-94e3-d1756b51ea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d168bb-64d9-4787-bd05-c8168b29255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d168bb-64d9-4787-bd05-c8168b29255f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871b1fda-bb4b-4ea7-b235-be4569936131', 'volume_name': 'volume-871b1fda-bb4b-4ea7-b235-be4569936131', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56f3e53-ede9-4087-9828-8627fc67c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56f3e53-ede9-4087-9828-8627fc67c85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cabe9a7-775c-430b-8e28-0862c3c09b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:10 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Volume 871b1fda-bb4b-4ea7-b235-be4569936131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871b1fda-bb4b-4ea7-b235-be4569936131', 'volume_size': 1} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-963984434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871b1fda-bb4b-4ea7-b235-be4569936131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43de7362d4634a45bda147ee65642cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:10Z,use_quota=True,user_id='603a2b5f12a440808754ef5fccab2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Creating volume 871b1fda-bb4b-4ea7-b235-be4569936131 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:41:10 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-c06c3103-db82-439d-a702-e365dfa5a29a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:10 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 1073741824 Jul 07 10:41:10 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Lock "cinder-c06c3103-db82-439d-a702-e365dfa5a29a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Acquiring lock "cinder-quobyte-c06c3103-db82-439d-a702-e365dfa5a29a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-c06c3103-db82-439d-a702-e365dfa5a29a" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be3f56-9df7-4138-8caf-9edbad6ef7e9]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:11 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a Jul 07 10:41:11 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:11 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:11 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:41:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Deleted volume successfully. Jul 07 10:41:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6d4fc71b-9ae5-48b3-9a43-4e2ab19692dc tempest-VolumesGetTest-1855081002 None] Lock "cinder-61564daf-d00e-4056-8194-b18d01feccc5-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:11 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 1073741824" returned: 0 in 1.278s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:12 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 Jul 07 10:41:12 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:12 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a" returned: 0 in 1.175s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:12 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a Jul 07 10:41:12 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:12 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cabe9a7-775c-430b-8e28-0862c3c09b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871b1fda-bb4b-4ea7-b235-be4569936131', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b647898-5ffb-4c42-87b3-bff997ff6f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:13 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Volume volume-871b1fda-bb4b-4ea7-b235-be4569936131 (871b1fda-bb4b-4ea7-b235-be4569936131): created successfully Jul 07 10:41:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b647898-5ffb-4c42-87b3-bff997ff6f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Flow 'volume_create_manager' (bbc8f796-92df-4a76-99b1-d044af74bbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d2602c07-fa68-42f9-bca5-46d1de2071bb tempest-AttachVolumeTestJSON-1667183289 None] Created volume successfully. Jul 07 10:41:13 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a" returned: 1 in 1.022s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:41:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:13 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a Jul 07 10:41:13 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:13 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c06c3103-db82-439d-a702-e365dfa5a29a" returned: 0 in 0.784s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Lock "cinder-quobyte-c06c3103-db82-439d-a702-e365dfa5a29a" released by "delete_volume" :: held 3.088s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:14 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Created reservations ['9c4cf01b-6698-4fb8-97a7-4cdc2afe5fa5', '92504228-12f8-42e3-acd9-0a2c24396d68', '80e77a32-0af2-44ed-9384-ca5659c09198', 'f174dcf2-f7fa-4eb8-99da-1e96a07502f1'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:14 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:41:14 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:15 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.825s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:15 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:41:15 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Deleted volume successfully. Jul 07 10:41:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5727a745-4246-439c-a033-a16ad97a59c6 tempest-VolumesGetTest-1855081002 None] Lock "cinder-c06c3103-db82-439d-a702-e365dfa5a29a-delete_volume" released by "delete_volume" :: held 4.249s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-9f2dc85b-3dae-4e07-83de-22a0ef617c2a req-1ca6340c-0e57-486a-b0aa-bbb63918f8e5 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-9f2dc85b-3dae-4e07-83de-22a0ef617c2a req-1ca6340c-0e57-486a-b0aa-bbb63918f8e5 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a33259-6b06-4fd2-acca-b0fa7136d3b7]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-9f2dc85b-3dae-4e07-83de-22a0ef617c2a req-1ca6340c-0e57-486a-b0aa-bbb63918f8e5 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:17 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 Jul 07 10:41:17 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:17 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-9f2dc85b-3dae-4e07-83de-22a0ef617c2a req-1ca6340c-0e57-486a-b0aa-bbb63918f8e5 tempest-AttachVolumeTestJSON-1667183289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131" returned: 0 in 1.004s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-9f2dc85b-3dae-4e07-83de-22a0ef617c2a req-1ca6340c-0e57-486a-b0aa-bbb63918f8e5 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.056s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-9f2dc85b-3dae-4e07-83de-22a0ef617c2a req-1ca6340c-0e57-486a-b0aa-bbb63918f8e5 tempest-AttachVolumeTestJSON-1667183289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-871b1fda-bb4b-4ea7-b235-be4569936131', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce293e10-557e-4fb8-9c40-3c8f37a374e8', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:41:18 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-9f2dc85b-3dae-4e07-83de-22a0ef617c2a req-1ca6340c-0e57-486a-b0aa-bbb63918f8e5 tempest-AttachVolumeTestJSON-1667183289 None] attachment_update completed successfully. Jul 07 10:41:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:41:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:23 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:41:23 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Flow 'volume_create_manager' (a3b7d5e5-ddb9-4fe9-9864-fdd63ed3595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5efa1b8-3d74-482d-bdb3-a44f5b739719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5efa1b8-3d74-482d-bdb3-a44f5b739719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-799176687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929d846b-5a41-4ab7-bfb8-7f30ff8255f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453b2e57ff0646628ad0b7165e857907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:24Z,use_quota=True,user_id='3a2e165c739d497cb650b57bfdfc1d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02470fb0-c25c-4e56-9778-d5c94e8830e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02470fb0-c25c-4e56-9778-d5c94e8830e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f156edfe-b701-42a3-b590-8ee98d2fd1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f156edfe-b701-42a3-b590-8ee98d2fd1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929d846b-5a41-4ab7-bfb8-7f30ff8255f6', 'volume_name': 'volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9a6a27-46e2-469d-8758-40ae46e02de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9a6a27-46e2-469d-8758-40ae46e02de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48f9d25-98b2-4fc5-aa20-b5e641c1266d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6', 'volume_size': 1} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-799176687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929d846b-5a41-4ab7-bfb8-7f30ff8255f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453b2e57ff0646628ad0b7165e857907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:24Z,use_quota=True,user_id='3a2e165c739d497cb650b57bfdfc1d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Creating volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:41:24 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:24 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 1073741824 Jul 07 10:41:24 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:24 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.817s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:41:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:41:25 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 1073741824" returned: 0 in 1.022s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:25 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-34fdf84d-f1c2-4256-8036-a16134d6feac req-24a530f8-4bfe-4191-8e0a-51f93f357894 tempest-AttachVolumeTestJSON-1667183289 None] Terminate volume connection completed successfully. Jul 07 10:41:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-34fdf84d-f1c2-4256-8036-a16134d6feac req-24a530f8-4bfe-4191-8e0a-51f93f357894 tempest-AttachVolumeTestJSON-1667183289 None] Deleting attachment 74ed8647-7437-4a5b-a621-c5df0a398793. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:41:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:25 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 Jul 07 10:41:25 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:26 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" returned: 0 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48f9d25-98b2-4fc5-aa20-b5e641c1266d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0070529b-bc1d-4879-b786-cfe9f3acd8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:26 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Volume volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 (929d846b-5a41-4ab7-bfb8-7f30ff8255f6): created successfully Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0070529b-bc1d-4879-b786-cfe9f3acd8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Flow 'volume_create_manager' (a3b7d5e5-ddb9-4fe9-9864-fdd63ed3595c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-12a6c1ef-1ec0-43df-9667-dae7aa956bdf tempest-VolumesSnapshotListTestJSON-1778203082 None] Created volume successfully. Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Creating offline snapshot 36145e93-b35c-4ef7-b456-eceb26b79b18 of volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[17752a8d-d9d7-4ce5-89cb-b2e140670dee]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:26 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 Jul 07 10:41:26 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:27 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" returned: 0 in 0.978s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:27 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 1G Jul 07 10:41:27 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:28 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-a728ef1d-c154-4299-aa7d-20afab4fa1f6 req-3feefc7f-dae6-42bb-a6de-5e515a68d468 tempest-AttachVolumeTestJSON-1667183289 None] Terminate volume connection completed successfully. Jul 07 10:41:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-a728ef1d-c154-4299-aa7d-20afab4fa1f6 req-3feefc7f-dae6-42bb-a6de-5e515a68d468 tempest-AttachVolumeTestJSON-1667183289 None] Deleting attachment ce293e10-557e-4fb8-9c40-3c8f37a374e8. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:41:28 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 1G" returned: 0 in 1.091s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:28 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 Jul 07 10:41:28 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:29 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:29 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 is being set with open permissions: ugo+rw Jul 07 10:41:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:29 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 Jul 07 10:41:29 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:30 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18" returned: 0 in 0.915s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:30 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=130,cinder:INSERT=32,cinder:SELECT=100,cinder:DELETE=8 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:41:30 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=105,cinder:UPDATE=122,cinder:DELETE=14,cinder:INSERT=33 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:41:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:30 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.info Jul 07 10:41:30 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:31 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.info" returned: 0 in 0.767s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:31 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.info is being set with open permissions: ugo+rw Jul 07 10:41:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:31 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.info Jul 07 10:41:31 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:32 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.info" returned: 0 in 0.793s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.570s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:32 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-68a500d0-3a66-4494-8073-faeec23a67fd tempest-VolumesSnapshotListTestJSON-1778203082 None] Create snapshot completed successfully Jul 07 10:41:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Creating offline snapshot 147d947f-2ce1-495e-b0b4-685c4477eb8a of volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:41:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c30417-16ca-447a-87b8-dc642c817ce9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:33 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 Jul 07 10:41:33 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:34 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18" returned: 0 in 1.148s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:34 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a 1G Jul 07 10:41:34 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Flow 'volume_create_manager' (06fa7d7d-0cbb-430a-bc00-7ccea9c5a200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185e3db9-1542-4c5b-9344-6efa7f4e5f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185e3db9-1542-4c5b-9344-6efa7f4e5f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1591341883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df69b18-a88b-4259-beb1-468b3b57d329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a932ac78b757447aad03813998e2e346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:35Z,use_quota=True,user_id='e2f1f336dd7e4a2b80b12994361b9da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678963ad-a385-4c9f-ae3e-8c8adc25febf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678963ad-a385-4c9f-ae3e-8c8adc25febf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8962ed14-57bc-4cc1-8921-8f090613634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8962ed14-57bc-4cc1-8921-8f090613634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df69b18-a88b-4259-beb1-468b3b57d329', 'volume_name': 'volume-9df69b18-a88b-4259-beb1-468b3b57d329', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbde8e48-6213-4fcb-9520-db67bcd2bade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbde8e48-6213-4fcb-9520-db67bcd2bade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2a7534-73b6-4da5-bd99-9e4d3518ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:34 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Volume 9df69b18-a88b-4259-beb1-468b3b57d329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df69b18-a88b-4259-beb1-468b3b57d329', 'volume_size': 1} Jul 07 10:41:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:35 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a 1G" returned: 0 in 1.136s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:35 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a Jul 07 10:41:35 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:36 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a" returned: 0 in 0.839s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:36 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a is being set with open permissions: ugo+rw Jul 07 10:41:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:36 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a Jul 07 10:41:36 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:37 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a" returned: 0 in 0.700s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.968s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.204s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1591341883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df69b18-a88b-4259-beb1-468b3b57d329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a932ac78b757447aad03813998e2e346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:35Z,use_quota=True,user_id='e2f1f336dd7e4a2b80b12994361b9da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Creating volume 9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:41:37 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:37 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 1073741824 Jul 07 10:41:37 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:37 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-08b6b79d-ad45-4aaf-bdf0-5e44607cc9ba tempest-VolumesSnapshotListTestJSON-1778203082 None] Create snapshot completed successfully Jul 07 10:41:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:38 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 1073741824" returned: 0 in 1.079s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:38 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 Jul 07 10:41:38 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:39 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329" returned: 0 in 0.700s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.397s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2a7534-73b6-4da5-bd99-9e4d3518ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df69b18-a88b-4259-beb1-468b3b57d329', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71d050a-3689-4d51-b4a2-d889acae7d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Creating offline snapshot 838b0d0d-d2a8-4496-9cb5-91bd8af64aca of volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:41:39 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Volume volume-9df69b18-a88b-4259-beb1-468b3b57d329 (9df69b18-a88b-4259-beb1-468b3b57d329): created successfully Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71d050a-3689-4d51-b4a2-d889acae7d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Flow 'volume_create_manager' (06fa7d7d-0cbb-430a-bc00-7ccea9c5a200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[66544b52-a301-411a-91cb-4ba563e06244]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1c9198c7-50c8-44cd-adca-fe463ea02bf2 tempest-SnapshotDependencyTests-1319652812 None] Created volume successfully. Jul 07 10:41:39 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a Jul 07 10:41:39 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "cinder-871b1fda-bb4b-4ea7-b235-be4569936131-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-871b1fda-bb4b-4ea7-b235-be4569936131-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "cinder-quobyte-871b1fda-bb4b-4ea7-b235-be4569936131" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-quobyte-871b1fda-bb4b-4ea7-b235-be4569936131" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef32dd-f52e-49bd-a408-777ae39a3b34]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:40 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a" returned: 0 in 0.863s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:40 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca 1G Jul 07 10:41:40 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:40 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 Jul 07 10:41:40 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:40 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131" returned: 0 in 0.852s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:40 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131 Jul 07 10:41:40 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:40 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca 1G" returned: 0 in 0.931s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:41 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca Jul 07 10:41:41 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:41 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-871b1fda-bb4b-4ea7-b235-be4569936131" returned: 0 in 0.662s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-quobyte-871b1fda-bb4b-4ea7-b235-be4569936131" released by "delete_volume" :: held 1.567s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Created reservations ['a50903e0-9f79-4bdc-9a9d-9fbd516106cd', '27dac679-6d89-4431-a9c7-594696f1facb', '6f84765d-8a2e-44a6-aa56-1fcc0c13766a', '0e2eb715-474a-4511-ab82-b63f242a61bd'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:41 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:41 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca is being set with open permissions: ugo+rw Jul 07 10:41:41 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:41:41 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:41 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca Jul 07 10:41:41 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "cinder-d0a6e929-fac8-429e-a99d-2aa871f3064a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-d0a6e929-fac8-429e-a99d-2aa871f3064a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "cinder-quobyte-d0a6e929-fac8-429e-a99d-2aa871f3064a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-quobyte-d0a6e929-fac8-429e-a99d-2aa871f3064a" acquired by "delete_volume" :: waited 0.046s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f453ea66-fc01-43b2-80dd-73b2c8ea0dde]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:42 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.921s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:41:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Deleted volume successfully. Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7136109f-c7dd-4e7e-9afc-d9fa1197b6f2 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-871b1fda-bb4b-4ea7-b235-be4569936131-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:42 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a Jul 07 10:41:42 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:42 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca" returned: 0 in 1.169s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.940s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.413s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Creating offline snapshot 0724bd7e-945c-498b-8660-f7e53c302e76 of volume 9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:41:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-dde7ec09-078e-424c-96f2-b3156c7c0a3e tempest-VolumesSnapshotListTestJSON-1778203082 None] Create snapshot completed successfully Jul 07 10:41:43 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e0362e-bc49-4c43-93d8-cbf16ed55905]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:43 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 Jul 07 10:41:43 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:43 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a" returned: 0 in 0.938s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:43 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a Jul 07 10:41:43 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:43 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329" returned: 0 in 0.868s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:43 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 1G Jul 07 10:41:43 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:44 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d0a6e929-fac8-429e-a99d-2aa871f3064a" returned: 0 in 0.786s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-quobyte-d0a6e929-fac8-429e-a99d-2aa871f3064a" released by "delete_volume" :: held 1.819s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Created reservations ['5b548f06-5d13-45c9-8fad-99febf639c64', 'ca32fa99-c389-475d-9757-bb5146bfebeb', '245b979b-1e4f-4b56-bea6-d1068eba0261', '6516be23-9219-4ec4-9949-36b04e00db33'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:44 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:41:44 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "cinder-b2d82af9-a518-4f88-8238-5058e54026ef-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-b2d82af9-a518-4f88-8238-5058e54026ef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "cinder-quobyte-b2d82af9-a518-4f88-8238-5058e54026ef" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-quobyte-b2d82af9-a518-4f88-8238-5058e54026ef" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-838b0d0d-d2a8-4496-9cb5-91bd8af64aca-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-838b0d0d-d2a8-4496-9cb5-91bd8af64aca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bf1bed-3ec9-4f98-a2ec-5586b2b7e6db]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-quobyte-838b0d0d-d2a8-4496-9cb5-91bd8af64aca" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-838b0d0d-d2a8-4496-9cb5-91bd8af64aca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Deleting offline snapshot 838b0d0d-d2a8-4496-9cb5-91bd8af64aca of volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] snapshot_file for this snap is: volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d190d-0621-4dc2-89f8-612a024f4333]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:45 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef Jul 07 10:41:45 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:45 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 1G" returned: 0 in 1.409s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df69b18-a88b-4259-beb1-468b3b57d329 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:45 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df69b18-a88b-4259-beb1-468b3b57d329 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 Jul 07 10:41:45 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:45 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca Jul 07 10:41:45 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:45 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.194s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:41:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Deleted volume successfully. Jul 07 10:41:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c362c55-ece2-409d-9cf6-f47bc65174c1 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-d0a6e929-fac8-429e-a99d-2aa871f3064a-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:46 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef" returned: 0 in 1.095s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:46 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef Jul 07 10:41:46 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:46 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df69b18-a88b-4259-beb1-468b3b57d329 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76" returned: 0 in 1.170s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:46 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 is being set with open permissions: ugo+rw Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:46 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca" returned: 0 in 1.322s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:46 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 Jul 07 10:41:46 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dedc22-f745-4ead-8220-e82282d01997]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:46 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a Jul 07 10:41:46 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:46 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b2d82af9-a518-4f88-8238-5058e54026ef" returned: 0 in 0.829s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-quobyte-b2d82af9-a518-4f88-8238-5058e54026ef" released by "delete_volume" :: held 2.017s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Created reservations ['8a0f1549-42c5-4cf6-8c20-820a9948c627', 'f5d9ad60-0f49-489e-ad9f-66585d2f1bc8', '74e187cd-5e0d-46b9-8caa-8d679098cd9c', '74637f86-89d4-4eef-907b-4d37e5ba4140'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:47 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:41:47 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:47 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76" returned: 0 in 0.956s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:47 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.info Jul 07 10:41:47 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:47 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a" returned: 0 in 1.092s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:47 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca Jul 07 10:41:47 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:48 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.info" returned: 0 in 0.889s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:48 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.info is being set with open permissions: ugo+rw Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:48 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.184s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:48 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.info Jul 07 10:41:48 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:41:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Deleted volume successfully. Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-04af59c5-a6a4-46e0-a215-77e59d172fe8 tempest-AttachVolumeTestJSON-1667183289 None] Lock "cinder-b2d82af9-a518-4f88-8238-5058e54026ef-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (d860ccbe-2c3e-4b69-91c5-545ca3a79d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae24eef0-626a-47ba-9765-c6bac91fdd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae24eef0-626a-47ba-9765-c6bac91fdd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519091368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4e7c3b-a50d-4605-8e2a-2b3c99069375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:49Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73bcdcb-d2e7-4048-a477-9ff5bf826e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73bcdcb-d2e7-4048-a477-9ff5bf826e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03066c0b-f4be-4617-8d5b-38b0f880a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03066c0b-f4be-4617-8d5b-38b0f880a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4e7c3b-a50d-4605-8e2a-2b3c99069375', 'volume_name': 'volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64dd1e7-c5fc-4d3f-9598-f710a6400d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64dd1e7-c5fc-4d3f-9598-f710a6400d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ed9b2f-da53-4b88-9fcb-b0414361e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Volume ec4e7c3b-a50d-4605-8e2a-2b3c99069375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375', 'volume_size': 1} Jul 07 10:41:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:49 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca" returned: 0 in 1.513s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:49 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca Jul 07 10:41:49 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:49 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.info" returned: 0 in 0.841s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.264s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519091368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4e7c3b-a50d-4605-8e2a-2b3c99069375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:49Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Creating volume ec4e7c3b-a50d-4605-8e2a-2b3c99069375 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:41:49 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:49 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 1073741824 Jul 07 10:41:49 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bedf6001-f9ab-48c1-ae0e-0cae965a76b7 tempest-SnapshotDependencyTests-1319652812 None] Create snapshot completed successfully Jul 07 10:41:49 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.838b0d0d-d2a8-4496-9cb5-91bd8af64aca" returned: 0 in 0.747s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-838b0d0d-d2a8-4496-9cb5-91bd8af64aca" released by "_delete_snapshot" :: held 4.828s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" released by "delete_snapshot" :: held 4.860s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Created reservations ['c3a7e8fb-f68b-4e96-8404-99f80c1d16bc', 'e335cc95-f24b-4184-9455-934cd6b48c9d', '3de49e02-5041-431d-ad7b-57bba2a95f9f', '8454aca3-3300-40f8-90d0-b12adbd67cf1'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Delete snapshot completed successfully. Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b392eec1-d0ff-492a-b5a3-bb5c65f73631 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-838b0d0d-d2a8-4496-9cb5-91bd8af64aca-delete_snapshot" released by "delete_snapshot" :: held 5.114s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:50 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 1073741824" returned: 0 in 1.116s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:50 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 Jul 07 10:41:50 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-147d947f-2ce1-495e-b0b4-685c4477eb8a-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-147d947f-2ce1-495e-b0b4-685c4477eb8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-quobyte-147d947f-2ce1-495e-b0b4-685c4477eb8a" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-147d947f-2ce1-495e-b0b4-685c4477eb8a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Deleting offline snapshot 147d947f-2ce1-495e-b0b4-685c4477eb8a of volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] snapshot_file for this snap is: volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d487bc97-35a8-477c-b856-dae8a649bb81]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:51 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a Jul 07 10:41:51 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Flow 'volume_create_manager' (31d60118-a9f7-4741-bf3e-8e8ac5fe668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fc7018-1b9e-417b-a6a2-82899e79b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fc7018-1b9e-417b-a6a2-82899e79b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e24f81-b4fa-4037-9fbb-f94f35d7c0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a932ac78b757447aad03813998e2e346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0724bd7e-945c-498b-8660-f7e53c302e76,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:41:51Z,use_quota=True,user_id='e2f1f336dd7e4a2b80b12994361b9da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92b6047-fb87-4fbc-9e6e-e130ec59fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92b6047-fb87-4fbc-9e6e-e130ec59fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffcd849-b596-433d-880b-b3dce706ea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffcd849-b596-433d-880b-b3dce706ea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19e24f81-b4fa-4037-9fbb-f94f35d7c0cd', 'volume_name': 'volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd', 'volume_size': 1, 'snapshot_id': '0724bd7e-945c-498b-8660-f7e53c302e76'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee830068-9f38-4b71-afdd-915213e98778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee830068-9f38-4b71-afdd-915213e98778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d749b38-b2fc-4c7a-9802-68b0b61639f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:51 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Volume 19e24f81-b4fa-4037-9fbb-f94f35d7c0cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd', 'volume_size': 1, 'snapshot_id': '0724bd7e-945c-498b-8660-f7e53c302e76'} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:51 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" returned: 0 in 1.128s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.073s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-quobyte-0724bd7e-945c-498b-8660-f7e53c302e76-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ed9b2f-da53-4b88-9fcb-b0414361e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636897d2-e622-419e-ae19-551cb5708226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-0724bd7e-945c-498b-8660-f7e53c302e76-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Creating volume 19e24f81-b4fa-4037-9fbb-f94f35d7c0cd from snapshot 0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-quobyte-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:51 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Volume volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 (ec4e7c3b-a50d-4605-8e2a-2b3c99069375): created successfully Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636897d2-e622-419e-ae19-551cb5708226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (d860ccbe-2c3e-4b69-91c5-545ca3a79d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:41:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8b28fb2b-772e-49dd-b44a-298dd9ad87a6 tempest-VolumesActionsTest-412707665 None] Created volume successfully. Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] snapshot: 0724bd7e-945c-498b-8660-f7e53c302e76, volume: 19e24f81-b4fa-4037-9fbb-f94f35d7c0cd, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac553e6-ffd8-402d-98ad-c0b3ecaa2380]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:51 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 Jul 07 10:41:51 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c62ec171-d9fb-478e-8ccf-679cf2e372dd tempest-VolumesActionsTest-412707665 None] Acquiring lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" by "attach_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c62ec171-d9fb-478e-8ccf-679cf2e372dd tempest-VolumesActionsTest-412707665 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" acquired by "attach_volume" :: waited 0.033s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:52 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c62ec171-d9fb-478e-8ccf-679cf2e372dd tempest-VolumesActionsTest-412707665 None] Attaching volume ec4e7c3b-a50d-4605-8e2a-2b3c99069375 to instance bf93c7e8-6bd2-4c7d-a94b-b70fb76e85fc at mountpoint /dev/vdb on host None. Jul 07 10:41:52 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c62ec171-d9fb-478e-8ccf-679cf2e372dd tempest-VolumesActionsTest-412707665 None] Attach volume completed successfully. Jul 07 10:41:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c62ec171-d9fb-478e-8ccf-679cf2e372dd tempest-VolumesActionsTest-412707665 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" released by "attach_volume" :: held 0.400s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:52 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a" returned: 0 in 1.747s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ee5ced-2d1c-463e-ac8c-668e5ee1868f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:52 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 Jul 07 10:41:52 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:53 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76" returned: 0 in 1.318s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df69b18-a88b-4259-beb1-468b3b57d329(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[830fa55f-6556-4c36-8801-c87720dafe77]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:53 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 Jul 07 10:41:53 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ed8a5990-3a10-4cfe-ac11-0d4bf800b637 tempest-VolumesActionsTest-2146496310 None] Terminate volume connection completed successfully. Jul 07 10:41:53 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18" returned: 0 in 1.195s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:53 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a Jul 07 10:41:53 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ed8a5990-3a10-4cfe-ac11-0d4bf800b637 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-detach_volume" by "detach_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ed8a5990-3a10-4cfe-ac11-0d4bf800b637 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ed8a5990-3a10-4cfe-ac11-0d4bf800b637 tempest-VolumesActionsTest-2146496310 None] Detaching volume ec4e7c3b-a50d-4605-8e2a-2b3c99069375 from instance bf93c7e8-6bd2-4c7d-a94b-b70fb76e85fc. Jul 07 10:41:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ed8a5990-3a10-4cfe-ac11-0d4bf800b637 tempest-VolumesActionsTest-2146496310 None] Detach volume completed successfully. Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ed8a5990-3a10-4cfe-ac11-0d4bf800b637 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-detach_volume" released by "detach_volume" :: held 0.137s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:54 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329" returned: 0 in 1.214s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:54 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd Jul 07 10:41:54 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82e8f361-f6cb-4a2f-a05d-cbab0993e6af tempest-VolumesActionsTest-412707665 None] Acquiring lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-detach_volume" by "detach_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82e8f361-f6cb-4a2f-a05d-cbab0993e6af tempest-VolumesActionsTest-412707665 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-82e8f361-f6cb-4a2f-a05d-cbab0993e6af tempest-VolumesActionsTest-412707665 None] Volume detach called, but volume not attached. Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82e8f361-f6cb-4a2f-a05d-cbab0993e6af tempest-VolumesActionsTest-412707665 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:54 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a" returned: 0 in 1.227s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:54 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a Jul 07 10:41:54 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Acquiring lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Acquiring lock "cinder-quobyte-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Lock "cinder-quobyte-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" acquired by "delete_volume" :: waited 0.042s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:56 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed52113-4a5e-4ab9-af3e-8989c94a3a7c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:56 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 Jul 07 10:41:56 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:56 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.147d947f-2ce1-495e-b0b4-685c4477eb8a" returned: 0 in 1.486s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-147d947f-2ce1-495e-b0b4-685c4477eb8a" released by "_delete_snapshot" :: held 5.842s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" released by "delete_snapshot" :: held 5.898s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:56 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Created reservations ['9996db2c-d764-41a7-908f-7c7bf4250331', '95fd5ebd-4496-4e90-8cb9-c6804f08f763', 'd5788f97-82a2-4579-a687-48cb5fd07660', '78cf05a5-c3f1-4ff6-b5a4-5bf3b76f3ac8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:41:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Delete snapshot completed successfully. Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8601b705-b208-49df-abeb-325e9f33eb93 tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-147d947f-2ce1-495e-b0b4-685c4477eb8a-delete_snapshot" released by "delete_snapshot" :: held 6.428s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-36145e93-b35c-4ef7-b456-eceb26b79b18-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-36145e93-b35c-4ef7-b456-eceb26b79b18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-quobyte-36145e93-b35c-4ef7-b456-eceb26b79b18" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-36145e93-b35c-4ef7-b456-eceb26b79b18" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Deleting offline snapshot 36145e93-b35c-4ef7-b456-eceb26b79b18 of volume 929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] snapshot_file for this snap is: volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4820c53-1855-4edd-b59a-6de7d612c139]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:58 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 Jul 07 10:41:58 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:58 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" returned: 0 in 2.854s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:58 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375 Jul 07 10:41:58 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:41:59 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 07 10:41:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18" returned: 0 in 1.554s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:41:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:41:59 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[43170efe-a635-4ed1-bed3-0f35579fac4b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:41:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:41:59 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 Jul 07 10:41:59 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:00 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" returned: 0 in 1.305s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Lock "cinder-quobyte-ec4e7c3b-a50d-4605-8e2a-2b3c99069375" released by "delete_volume" :: held 4.317s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Created reservations ['007d080b-f7ef-4290-840b-6d7fc4a286da', 'af016212-71b8-4f7f-b846-875d5a440792', '4a006345-09ab-4532-8d8f-aef9060109c6', 'fa132409-fc22-40ca-b358-297b7d095e3c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:00 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:00 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:01 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" returned: 0 in 2.136s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:01 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 Jul 07 10:42:01 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:02 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" returned: 0 in 7.752s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[11581916-e765-4874-a819-eb4c212138b0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:02 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:02 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 Jul 07 10:42:02 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.625s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:02 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Deleted volume successfully. Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b61f0987-c8a5-4496-85fc-d75928a924cc tempest-VolumesActionsTest-412707665 None] Lock "cinder-ec4e7c3b-a50d-4605-8e2a-2b3c99069375-delete_volume" released by "delete_volume" :: held 6.546s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:02 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18" returned: 0 in 1.016s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:02 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18 Jul 07 10:42:02 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Flow 'volume_create_manager' (9f425df9-ef02-48b8-a963-244d2cca7238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c03cad-2960-41a9-bea9-c5bdbeef86e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c03cad-2960-41a9-bea9-c5bdbeef86e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-316462041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e474639-9ca2-4952-99c7-4e2fc1626153,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59dffb5ff06a4071871a54163e495c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:03Z,use_quota=True,user_id='b07a0246b8bd4a55ad8f0d4748bba723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9c8619-58b3-4bd7-9f62-2132a85a8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9c8619-58b3-4bd7-9f62-2132a85a8b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7033901f-1232-453a-90c3-88d7dd92a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7033901f-1232-453a-90c3-88d7dd92a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e474639-9ca2-4952-99c7-4e2fc1626153', 'volume_name': 'volume-5e474639-9ca2-4952-99c7-4e2fc1626153', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c71eac9-bfb3-42f8-9696-3c5d9d64a147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c71eac9-bfb3-42f8-9696-3c5d9d64a147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162b27ce-b802-4836-9eb5-c2fed947f949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:02 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Volume 5e474639-9ca2-4952-99c7-4e2fc1626153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e474639-9ca2-4952-99c7-4e2fc1626153', 'volume_size': 1} Jul 07 10:42:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:03 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329" returned: 0 in 1.030s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:42:03 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Converted 1024.00 MB image at 132.07 MB/s Jul 07 10:42:03 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd is being set with open permissions: ugo+rw Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:03 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd Jul 07 10:42:03 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:03 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6.36145e93-b35c-4ef7-b456-eceb26b79b18" returned: 0 in 0.853s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-36145e93-b35c-4ef7-b456-eceb26b79b18" released by "_delete_snapshot" :: held 5.892s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" released by "delete_snapshot" :: held 5.966s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Created reservations ['e2f41602-8545-4b30-a684-e8363919aff9', 'bd8b732f-ccae-4fa5-86d7-4799fa121846', '81fec31f-2fe6-464e-8675-4846702b15be', 'd23aeda2-8131-4be2-8376-59184628b91a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Delete snapshot completed successfully. Jul 07 10:42:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-63b8974d-de70-404c-b9b4-03675b37e2ed tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-36145e93-b35c-4ef7-b456-eceb26b79b18-delete_snapshot" released by "delete_snapshot" :: held 6.165s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:04 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" returned: 0 in 0.925s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" released by "_copy_volume_from_snapshot" :: held 12.357s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-0724bd7e-945c-498b-8660-f7e53c302e76-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" released by "_create_volume_from_snapshot" :: held 12.427s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.472s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-316462041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e474639-9ca2-4952-99c7-4e2fc1626153,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59dffb5ff06a4071871a54163e495c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:03Z,use_quota=True,user_id='b07a0246b8bd4a55ad8f0d4748bba723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Creating volume 5e474639-9ca2-4952-99c7-4e2fc1626153 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:04 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:04 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 1073741824 Jul 07 10:42:04 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d749b38-b2fc-4c7a-9802-68b0b61639f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd', 'volume_size': 1, 'snapshot_id': '0724bd7e-945c-498b-8660-f7e53c302e76'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17db3b5-b1bd-4b99-85dc-44138d528fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-929d846b-5a41-4ab7-bfb8-7f30ff8255f6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-929d846b-5a41-4ab7-bfb8-7f30ff8255f6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:04 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Volume volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd (19e24f81-b4fa-4037-9fbb-f94f35d7c0cd): created successfully Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17db3b5-b1bd-4b99-85dc-44138d528fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Flow 'volume_create_manager' (31d60118-a9f7-4741-bf3e-8e8ac5fe668d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-be96e0ed-f893-4024-9d27-312695fd0df4 tempest-SnapshotDependencyTests-1319652812 None] Created volume successfully. Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af7bd5b-92d5-450e-a2a9-db816f6110f8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:04 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 Jul 07 10:42:04 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-0724bd7e-945c-498b-8660-f7e53c302e76-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-0724bd7e-945c-498b-8660-f7e53c302e76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-quobyte-9df69b18-a88b-4259-beb1-468b3b57d329" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-9df69b18-a88b-4259-beb1-468b3b57d329" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-quobyte-0724bd7e-945c-498b-8660-f7e53c302e76" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-0724bd7e-945c-498b-8660-f7e53c302e76" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Deleting offline snapshot 0724bd7e-945c-498b-8660-f7e53c302e76 of volume 9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:42:05 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] snapshot_file for this snap is: volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 1073741824" returned: 0 in 0.999s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37dbb68-ac1f-4eac-85df-5282cbb6e463]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:05 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 Jul 07 10:42:05 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:05 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" returned: 0 in 0.873s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:05 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 Jul 07 10:42:05 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:05 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6 Jul 07 10:42:05 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:05 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153" returned: 0 in 0.738s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:05 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162b27ce-b802-4836-9eb5-c2fed947f949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e474639-9ca2-4952-99c7-4e2fc1626153', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bae88e-9311-4bb2-8c40-2f033354610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" returned: 0 in 0.729s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-quobyte-929d846b-5a41-4ab7-bfb8-7f30ff8255f6" released by "delete_volume" :: held 1.671s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:05 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Volume volume-5e474639-9ca2-4952-99c7-4e2fc1626153 (5e474639-9ca2-4952-99c7-4e2fc1626153): created successfully Jul 07 10:42:05 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bae88e-9311-4bb2-8c40-2f033354610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Flow 'volume_create_manager' (9f425df9-ef02-48b8-a963-244d2cca7238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76" returned: 0 in 0.872s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df69b18-a88b-4259-beb1-468b3b57d329(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:42:05 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-3b36faee-b66b-40e7-8ed0-e2b93865764b req-9cb15448-d06e-49d6-ab26-cb96b319f755 tempest-VolumesGetTestJSON-104065605 None] Created volume successfully. Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c2296f-2c7d-43e9-8f74-61b59d16c9df]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Created reservations ['bfe99d46-6510-4f3c-b7fe-74c8c06f2129', '32f55f35-0a09-4eb7-b15b-cb7dd6120077', '6e329d8b-4372-4652-8a6e-b1247463697c', '394bae92-64f1-4c0c-89f8-c41347084ad7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:06 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 Jul 07 10:42:06 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:06 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:06 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Acquiring lock "cinder-5e474639-9ca2-4952-99c7-4e2fc1626153-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Lock "cinder-5e474639-9ca2-4952-99c7-4e2fc1626153-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Acquiring lock "cinder-quobyte-5e474639-9ca2-4952-99c7-4e2fc1626153" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Lock "cinder-quobyte-5e474639-9ca2-4952-99c7-4e2fc1626153" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed252c-1f64-419d-82dd-13fa4e11897f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:06 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 Jul 07 10:42:06 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:06 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.814s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:06 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Deleted volume successfully. Jul 07 10:42:07 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fdb6ae2f-0255-4181-aad6-de404359938f tempest-VolumesSnapshotListTestJSON-1778203082 None] Lock "cinder-929d846b-5a41-4ab7-bfb8-7f30ff8255f6-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329" returned: 0 in 1.006s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:07 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 Jul 07 10:42:07 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:07 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153" returned: 0 in 0.979s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:07 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153 Jul 07 10:42:07 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:07 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76" returned: 0 in 0.844s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:07 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76 Jul 07 10:42:07 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:08 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5e474639-9ca2-4952-99c7-4e2fc1626153" returned: 0 in 0.842s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Lock "cinder-quobyte-5e474639-9ca2-4952-99c7-4e2fc1626153" released by "delete_volume" :: held 1.890s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.quota [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Created reservations ['a8ff52bd-1ab0-48c3-a11d-c4d9986a7eff', '7243516d-80f0-4e17-adb0-96222b0091cf', '9097ef72-2096-4861-9b19-43aa2185c769', '8a2edbdd-6c29-415d-a641-be4c814ca7d9'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:08 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:08 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:08 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329.0724bd7e-945c-498b-8660-f7e53c302e76" returned: 0 in 0.759s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-0724bd7e-945c-498b-8660-f7e53c302e76" released by "_delete_snapshot" :: held 3.631s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-9df69b18-a88b-4259-beb1-468b3b57d329" released by "delete_snapshot" :: held 3.665s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Created reservations ['423705e7-2b85-47ff-8cf5-7c7631388c16', '0a9b3d11-0acc-4ba8-bef9-2bb4db4c67ea', 'f0211c91-c1d7-4a4a-98f9-11a18258f3d1', 'c6336da2-d533-44e8-9edf-aca7202925e4'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:08 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Delete snapshot completed successfully. Jul 07 10:42:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d6b3c511-b042-4461-aad9-e4e9807008f9 tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-0724bd7e-945c-498b-8660-f7e53c302e76-delete_snapshot" released by "delete_snapshot" :: held 3.905s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-9df69b18-a88b-4259-beb1-468b3b57d329-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-9df69b18-a88b-4259-beb1-468b3b57d329-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:09 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.926s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.manager [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-quobyte-9df69b18-a88b-4259-beb1-468b3b57d329" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Deleted volume successfully. Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-9df69b18-a88b-4259-beb1-468b3b57d329" acquired by "delete_volume" :: waited 0.033s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-ef149a53-08eb-44c7-a043-63507ed7dfc4 req-1c1e2098-0d25-49b8-b659-81ccb317f9f2 tempest-VolumesGetTestJSON-104065605 None] Lock "cinder-5e474639-9ca2-4952-99c7-4e2fc1626153-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0bb64b-be22-464d-9d51-8804eb80bdc1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:09 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 Jul 07 10:42:09 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (29762deb-b5a1-4182-bc2f-2f9475b6e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6debc2-f9fe-43ba-9ca3-61e9919f8989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6debc2-f9fe-43ba-9ca3-61e9919f8989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1412063940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5f17cc-8c92-4519-bb5a-c9d45ef300fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:10Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6578ad61-1405-4f1d-a12f-4355a802d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6578ad61-1405-4f1d-a12f-4355a802d029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216125b0-9b94-48d8-a5c3-ce46702c2e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216125b0-9b94-48d8-a5c3-ce46702c2e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5f17cc-8c92-4519-bb5a-c9d45ef300fa', 'volume_name': 'volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e05502-3430-4f55-a7f1-6ca61b011bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e05502-3430-4f55-a7f1-6ca61b011bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea47a1d-f3af-4dfd-b2c6-31d73659b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:09 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Volume 8a5f17cc-8c92-4519-bb5a-c9d45ef300fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa', 'volume_size': 1} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1412063940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5f17cc-8c92-4519-bb5a-c9d45ef300fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:10Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Creating volume 8a5f17cc-8c92-4519-bb5a-c9d45ef300fa {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:09 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:09 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa 1073741824 Jul 07 10:42:09 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:10 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329" returned: 0 in 1.025s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:10 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329 Jul 07 10:42:10 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Flow 'volume_create_manager' (63af0d86-0406-4322-a9e9-58c8e561fa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944533d9-89a9-46bc-98db-9c43eb89634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944533d9-89a9-46bc-98db-9c43eb89634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1612832043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1520caf8-e471-4db2-9947-3dbb28a1c0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed24354035be4461bb2d75404cc8c61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:11Z,use_quota=True,user_id='d1ce3d3615574dfe9a9e18c5e0e9307f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23faa538-c9e9-457b-b991-67b20ee36f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23faa538-c9e9-457b-b991-67b20ee36f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527c01dd-61b1-4434-9687-03584c68a036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527c01dd-61b1-4434-9687-03584c68a036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1520caf8-e471-4db2-9947-3dbb28a1c0e6', 'volume_name': 'volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6', 'volume_size': 2}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e39b2e3-e5ec-4762-81d5-aa2dc9598624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e39b2e3-e5ec-4762-81d5-aa2dc9598624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6094224d-ffe7-44a8-b667-f9aa706540d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:10 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Volume 1520caf8-e471-4db2-9947-3dbb28a1c0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6', 'volume_size': 2} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:10 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa 1073741824" returned: 0 in 1.045s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:11 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa Jul 07 10:42:11 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:11 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9df69b18-a88b-4259-beb1-468b3b57d329" returned: 0 in 0.821s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-9df69b18-a88b-4259-beb1-468b3b57d329" released by "delete_volume" :: held 1.939s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Created reservations ['5ea13ed6-4cf3-4baf-beba-00e532489998', '59f70890-642a-4c1e-883d-fa4f5690c306', '50afae4c-a3dc-4f4d-acb2-488eccbd70a0', 'bb2bc281-6b2d-46c5-8f41-f21a558ab3be'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:11 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:11 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:11 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa" returned: 0 in 0.742s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1612832043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1520caf8-e471-4db2-9947-3dbb28a1c0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed24354035be4461bb2d75404cc8c61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:11Z,use_quota=True,user_id='d1ce3d3615574dfe9a9e18c5e0e9307f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Creating volume 1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:11 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 2147483648 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "cinder-quobyte-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:11 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 2147483648 Jul 07 10:42:11 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea47a1d-f3af-4dfd-b2c6-31d73659b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232db2a-0078-4426-9e21-d0dfe9d1a662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" acquired by "delete_volume" :: waited 0.054s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Volume volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa (8a5f17cc-8c92-4519-bb5a-c9d45ef300fa): created successfully Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232db2a-0078-4426-9e21-d0dfe9d1a662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (29762deb-b5a1-4182-bc2f-2f9475b6e819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b12ae0-952d-4824-a4d5-6e16d32f8c81]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6a10e58d-52cf-4d3a-9fac-00b59261dcd7 tempest-VolumesActionsTest-412707665 None] Created volume successfully. Jul 07 10:42:12 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd Jul 07 10:42:12 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:12 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:12 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Deleted volume successfully. Jul 07 10:42:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae0c0d17-d555-40b1-8804-227510757c0f tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-9df69b18-a88b-4259-beb1-468b3b57d329-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:12 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:12 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" returned: 0 in 0.904s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 2147483648" returned: 0 in 1.034s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:12 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd Jul 07 10:42:12 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:12 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 Jul 07 10:42:12 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-quobyte-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[14994604-cbba-42ea-86f5-a131baf63d78]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:13 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" returned: 0 in 0.727s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:13 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa Jul 07 10:42:13 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-quobyte-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd" released by "delete_volume" :: held 1.710s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Created reservations ['61dceeb4-8c10-44fc-96c8-b9d8f03245b1', 'aa87e820-5046-4b6b-b518-e9276a74290a', '75f502e9-85ae-4288-886c-c827c3b4a456', '87a3e2cd-42f7-4409-bf51-41dfb3815169'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:13 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6094224d-ffe7-44a8-b667-f9aa706540d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6', 'volume_size': 2}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdde5c1-8d5b-4b9b-8425-165f4d983bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:13 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Volume volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 (1520caf8-e471-4db2-9947-3dbb28a1c0e6): created successfully Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdde5c1-8d5b-4b9b-8425-165f4d983bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Flow 'volume_create_manager' (63af0d86-0406-4322-a9e9-58c8e561fa6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-06220f95-731d-47d9-b7a8-155e9007f8fb tempest-GroupSnapshotsTest-29473418 None] Group tempest-GroupSnapshotsTest-Group-1899339307: creating Jul 07 10:42:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7ee93e0d-5ba1-4403-9aa7-6bb36b62992c tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Created volume successfully. Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-06220f95-731d-47d9-b7a8-155e9007f8fb tempest-GroupSnapshotsTest-29473418 None] Group tempest-GroupSnapshotsTest-Group-1899339307: created successfully Jul 07 10:42:13 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:13 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-06220f95-731d-47d9-b7a8-155e9007f8fb tempest-GroupSnapshotsTest-29473418 None] Create group completed successfully. Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Creating offline snapshot ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 of volume 1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b66475-1c39-4392-8125-29d75d856819]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:14 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa" returned: 0 in 1.028s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:14 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa Jul 07 10:42:14 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:14 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 Jul 07 10:42:14 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:14 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.818s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Deleted volume successfully. Jul 07 10:42:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69b3454e-5d2d-4f84-8ee1-7cf63ffa8d0e tempest-SnapshotDependencyTests-1319652812 None] Lock "cinder-19e24f81-b4fa-4037-9fbb-f94f35d7c0cd-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:15 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa" returned: 0 in 0.733s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa" released by "delete_volume" :: held 1.822s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:15 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6" returned: 0 in 0.858s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 2G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:15 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 2G Jul 07 10:42:15 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Created reservations ['9a24eaba-5078-48a1-89d8-abad20c7156b', 'd7117b99-148a-4590-9a71-ccd669ffaf5e', '50a588f8-dff3-41fb-9fe7-53eef6d65d20', 'b068af68-25f8-49dd-a7da-e42ad2139510'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:15 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:15 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (9197a352-ecca-4dc5-9041-a63417fd5930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba74cbc-4439-46e2-b94d-4a3ad17b109f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba74cbc-4439-46e2-b94d-4a3ad17b109f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1822415629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2939b376-1cfe-45c0-88d1-817a40a71ad4,host='devstack@QuobyteHD#QuobyteHD',id=94a70c30-dbd8-4b91-ae00-e32d3dd961c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:15Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(254b38b7-d64c-42f1-bef3-0b6487dd0d28),volume_type_id=254b38b7-d64c-42f1-bef3-0b6487dd0d28)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798801d3-7379-4edd-b284-7487b32353cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798801d3-7379-4edd-b284-7487b32353cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f3f477-fc84-4699-9b11-1b769deeb53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f3f477-fc84-4699-9b11-1b769deeb53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a70c30-dbd8-4b91-ae00-e32d3dd961c7', 'volume_name': 'volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8f4a38-98a6-42c4-9529-3ef6a81211bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8f4a38-98a6-42c4-9529-3ef6a81211bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cfba9f-6333-449d-b5c8-ee14ca4cf95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:15 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Volume 94a70c30-dbd8-4b91-ae00-e32d3dd961c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7', 'volume_size': 1} Jul 07 10:42:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (151bdf18-2625-4845-9674-f702ba353bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49cb29c-5263-455f-bea4-a66427820c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49cb29c-5263-455f-bea4-a66427820c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1531021182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c2c656-bd96-4226-b571-242e15ecc605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:16Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bbf69d-e849-4ee9-aed3-6c4994559ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bbf69d-e849-4ee9-aed3-6c4994559ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb39391c-58f0-45bb-b333-19f035816f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb39391c-58f0-45bb-b333-19f035816f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c2c656-bd96-4226-b571-242e15ecc605', 'volume_name': 'volume-d8c2c656-bd96-4226-b571-242e15ecc605', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29261f43-9047-450f-9c20-3e0bafc1d941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:16 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29261f43-9047-450f-9c20-3e0bafc1d941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35926b2-ec97-4cb9-9475-f742d8ee6f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:16 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Volume d8c2c656-bd96-4226-b571-242e15ecc605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c2c656-bd96-4226-b571-242e15ecc605', 'volume_size': 1} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 2G" returned: 0 in 1.141s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:16 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 Jul 07 10:42:16 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:16 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.984s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Deleted volume successfully. Jul 07 10:42:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b2dd2c83-6cb8-4b32-8b0b-7cc1fffec269 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-8a5f17cc-8c92-4519-bb5a-c9d45ef300fa-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:17 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" returned: 0 in 0.738s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:17 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 is being set with open permissions: ugo+rw Jul 07 10:42:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:17 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 Jul 07 10:42:17 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:17 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" returned: 0 in 0.719s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:17 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.info Jul 07 10:42:17 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:18 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.info" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:18 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.info is being set with open permissions: ugo+rw Jul 07 10:42:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:18 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.info Jul 07 10:42:18 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:19 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.info" returned: 0 in 0.660s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.016s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.587s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2939b376-1cfe-45c0-88d1-817a40a71ad4,created_at=2026-07-07T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1822415629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2939b376-1cfe-45c0-88d1-817a40a71ad4,host='devstack@QuobyteHD#QuobyteHD',id=94a70c30-dbd8-4b91-ae00-e32d3dd961c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:15Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(254b38b7-d64c-42f1-bef3-0b6487dd0d28),volume_type_id=254b38b7-d64c-42f1-bef3-0b6487dd0d28)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Creating volume 94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:19 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:19 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 1073741824 Jul 07 10:42:19 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8af1fc4f-6f84-4567-8512-bf00f8dced56 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Create snapshot completed successfully Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "cinder-ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "cinder-quobyte-1520caf8-e471-4db2-9947-3dbb28a1c0e6" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-quobyte-1520caf8-e471-4db2-9947-3dbb28a1c0e6" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "cinder-quobyte-ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-quobyte-ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Deleting offline snapshot ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 of volume 1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] snapshot_file for this snap is: volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c7961d-29df-4046-8f91-dd054d017c05]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:19 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 Jul 07 10:42:19 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:20 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 1073741824" returned: 0 in 0.952s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:20 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 Jul 07 10:42:20 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:20 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa83b670-fff7-451a-b4bb-416f0091f0ee]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:20 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 Jul 07 10:42:20 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:20 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" returned: 0 in 0.710s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.685s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1531021182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c2c656-bd96-4226-b571-242e15ecc605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:16Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Creating volume d8c2c656-bd96-4226-b571-242e15ecc605 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:21 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:21 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 1073741824 Jul 07 10:42:21 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cfba9f-6333-449d-b5c8-ee14ca4cf95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bff2ab-3ae1-4555-9ec3-d46a408bed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:21 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Volume volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 (94a70c30-dbd8-4b91-ae00-e32d3dd961c7): created successfully Jul 07 10:42:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bff2ab-3ae1-4555-9ec3-d46a408bed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (9197a352-ecca-4dc5-9041-a63417fd5930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-eeb1cc62-8243-4196-ba18-5a3d6c978c59 tempest-GroupSnapshotsTest-29473418 None] Created volume successfully. Jul 07 10:42:21 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6" returned: 0 in 0.814s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:21 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 Jul 07 10:42:21 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:22 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] GroupSnapshot 114ed428-8c21-4bc8-824f-2c9d83a70243: creating. Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Group snapshot 114ed428-8c21-4bc8-824f-2c9d83a70243: creating. {{(pid=87208) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 10:42:22 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 1073741824" returned: 0 in 1.135s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:22 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 Jul 07 10:42:22 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:22 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" returned: 0 in 0.987s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:22 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0 Jul 07 10:42:22 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:22 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605" returned: 0 in 0.715s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.779s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Creating offline snapshot 8db4dd57-ac44-458e-943a-88da4d185227 of volume 94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35926b2-ec97-4cb9-9475-f742d8ee6f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c2c656-bd96-4226-b571-242e15ecc605', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219daf0a-5990-4712-abfc-e9dce7df5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[56649228-98a5-4f6f-92ff-aaf397e7c0e8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:22 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Volume volume-d8c2c656-bd96-4226-b571-242e15ecc605 (d8c2c656-bd96-4226-b571-242e15ecc605): created successfully Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219daf0a-5990-4712-abfc-e9dce7df5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (151bdf18-2625-4845-9674-f702ba353bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-19ba87e0-5a24-45f1-b810-09e32a09bb7e tempest-VolumesActionsTest-412707665 None] Created volume successfully. Jul 07 10:42:23 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6.ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" returned: 0 in 0.727s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:23 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 Jul 07 10:42:23 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-quobyte-ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0" released by "_delete_snapshot" :: held 3.458s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-quobyte-1520caf8-e471-4db2-9947-3dbb28a1c0e6" released by "delete_snapshot" :: held 3.496s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Created reservations ['9e9c90d3-4864-42a3-a5ee-79686169c82f', '83a72e08-3d7c-4616-98b9-b780265773ab', '69cb5961-b6ee-414a-a217-5c74162974e8', '8dcda554-21ad-43fa-bbfe-76cfbc9a1144'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Delete snapshot completed successfully. Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-81d74ec2-fe2e-4aff-8e5d-d5b2009278d1 tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-ec37e9bd-4b78-4c61-9da6-99b1d86a7fd0-delete_snapshot" released by "delete_snapshot" :: held 3.742s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:23 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:23 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-d8c2c656-bd96-4226-b571-242e15ecc605-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-d8c2c656-bd96-4226-b571-242e15ecc605-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:23 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" returned: 0 in 0.915s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:23 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 1G Jul 07 10:42:23 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "cinder-1520caf8-e471-4db2-9947-3dbb28a1c0e6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-quobyte-d8c2c656-bd96-4226-b571-242e15ecc605" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-1520caf8-e471-4db2-9947-3dbb28a1c0e6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-d8c2c656-bd96-4226-b571-242e15ecc605" acquired by "delete_volume" :: waited 0.040s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb596b-215e-4c87-afdf-cb83df7bebc0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "cinder-quobyte-1520caf8-e471-4db2-9947-3dbb28a1c0e6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-quobyte-1520caf8-e471-4db2-9947-3dbb28a1c0e6" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d04148-3076-4fc9-a5d0-8268cbf086ee]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:24 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 Jul 07 10:42:24 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:24 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 Jul 07 10:42:24 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:24 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.896s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:42:24 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 1G" returned: 0 in 1.061s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:24 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 Jul 07 10:42:24 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:25 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605" returned: 0 in 1.139s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:25 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605 Jul 07 10:42:25 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:25 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6" returned: 0 in 1.053s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:25 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6 Jul 07 10:42:25 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:25 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227" returned: 0 in 0.825s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:25 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:25 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 Jul 07 10:42:25 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:25 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d8c2c656-bd96-4226-b571-242e15ecc605" returned: 0 in 0.677s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-d8c2c656-bd96-4226-b571-242e15ecc605" released by "delete_volume" :: held 1.873s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Created reservations ['862608ab-2157-4706-91b6-abdf57a08945', 'efd64dad-fa61-4e44-a00b-c1051ca5bc4e', '04354f35-8bba-4c26-a724-5423e0628ea6', '5c823a99-4514-4a54-b33a-26bafd2cfbc7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:25 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1520caf8-e471-4db2-9947-3dbb28a1c0e6" returned: 0 in 0.670s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-quobyte-1520caf8-e471-4db2-9947-3dbb28a1c0e6" released by "delete_volume" :: held 1.869s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:26 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:26 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Created reservations ['7897a76b-3556-46a8-b834-0ef4606e8c9c', 'f6955321-fe2c-4389-947c-e038ac234d5b', '69b8c655-4477-4f0c-8a5c-db74f44c01eb', '067198c5-f09b-4ef4-8107-91e6ca8cfa24'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:26 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:26 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:26 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227" returned: 0 in 0.910s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:26 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.info Jul 07 10:42:26 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:26 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.838s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Deleted volume successfully. Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-28f02cad-33b4-4254-8bcb-4eb8efd59d64 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-d8c2c656-bd96-4226-b571-242e15ecc605-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (c6e155f5-0960-4ed2-a44a-26698de1a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf025d8-f16a-4452-87a4-7a93e2249863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf025d8-f16a-4452-87a4-7a93e2249863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784314242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e3d07c-6648-419d-8ecd-3c912d944d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:27Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08827783-cb60-4759-bbf6-79321f7274b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08827783-cb60-4759-bbf6-79321f7274b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21783979-7697-4666-b123-f83dfbeca2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21783979-7697-4666-b123-f83dfbeca2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e3d07c-6648-419d-8ecd-3c912d944d18', 'volume_name': 'volume-d4e3d07c-6648-419d-8ecd-3c912d944d18', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ec48a4-220a-4f31-92d1-e36fac9af9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ec48a4-220a-4f31-92d1-e36fac9af9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1a4a96-5634-4779-9398-31f87472e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:27 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Volume d4e3d07c-6648-419d-8ecd-3c912d944d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e3d07c-6648-419d-8ecd-3c912d944d18', 'volume_size': 1} Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:27 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.933s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Deleted volume successfully. Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c9b7fbce-6c98-40d5-8010-fb2404b659da tempest-VolumesSnapshotNegativeTestJSON-201185434 None] Lock "cinder-1520caf8-e471-4db2-9947-3dbb28a1c0e6-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:27 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.info" returned: 0 in 0.757s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:27 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:42:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:27 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.info Jul 07 10:42:27 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:28 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.info" returned: 0 in 0.666s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.258s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784314242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e3d07c-6648-419d-8ecd-3c912d944d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:27Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Creating volume d4e3d07c-6648-419d-8ecd-3c912d944d18 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:28 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:28 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 1073741824 Jul 07 10:42:28 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:28 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9f0a76a3-9164-4e21-8fe2-bb00c855330c tempest-GroupSnapshotsTest-29473418 None] group_snapshot 114ed428-8c21-4bc8-824f-2c9d83a70243: created successfully Jul 07 10:42:29 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 1073741824" returned: 0 in 0.882s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:29 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 Jul 07 10:42:29 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:29 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18" returned: 0 in 0.671s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.087s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-8db4dd57-ac44-458e-943a-88da4d185227-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1a4a96-5634-4779-9398-31f87472e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e3d07c-6648-419d-8ecd-3c912d944d18', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b45388-b086-4495-aaae-0b2087ea061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-8db4dd57-ac44-458e-943a-88da4d185227-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Creating volume ae504539-0cda-4c45-9c4f-e6c9c5c92f9e from snapshot 8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] snapshot: 8db4dd57-ac44-458e-943a-88da4d185227, volume: ae504539-0cda-4c45-9c4f-e6c9c5c92f9e, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:42:29 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Volume volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 (d4e3d07c-6648-419d-8ecd-3c912d944d18): created successfully Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b45388-b086-4495-aaae-0b2087ea061f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (c6e155f5-0960-4ed2-a44a-26698de1a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b8f6fb82-41dd-45b4-b195-05b89159300c tempest-VolumesActionsTest-412707665 None] Created volume successfully. Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a7f218-a15b-474b-8dab-2c447acf71d6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:30 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 Jul 07 10:42:30 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-d4e3d07c-6648-419d-8ecd-3c912d944d18-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Lock "cinder-d4e3d07c-6648-419d-8ecd-3c912d944d18-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-quobyte-d4e3d07c-6648-419d-8ecd-3c912d944d18" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-d4e3d07c-6648-419d-8ecd-3c912d944d18" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c624f428-1346-4074-bbf5-557125d18173]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:30 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 Jul 07 10:42:30 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:30 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227" returned: 0 in 0.848s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d95ac7e-a606-4782-8f29-cb740978220e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:30 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 Jul 07 10:42:30 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:31 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18" returned: 0 in 0.810s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:31 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18 Jul 07 10:42:31 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:31 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" returned: 0 in 0.848s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:31 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e Jul 07 10:42:31 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:31 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d4e3d07c-6648-419d-8ecd-3c912d944d18" returned: 0 in 0.694s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-d4e3d07c-6648-419d-8ecd-3c912d944d18" released by "delete_volume" :: held 1.547s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=152,cinder:SELECT=135,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=130,cinder:UPDATE=158,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:42:31 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Created reservations ['83390d5c-85d8-4ab4-888f-a74d3f43da4c', '0fa732d7-1eb2-40ee-9f7f-04e2f56d9c4c', '523341a0-c7a7-4113-8aa8-c75b40cc8316', '29e19f54-41e0-4b7a-82fa-4d61a07cd080'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:32 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:32 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:32 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.888s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:32 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:32 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Deleted volume successfully. Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bba54ff4-57e6-4013-a465-6464e866edee tempest-VolumesActionsTest-2146496310 None] Lock "cinder-d4e3d07c-6648-419d-8ecd-3c912d944d18-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (cf53af97-e245-4a70-ac76-f2a96050aec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14740401-4887-49a6-942b-0a3adc6a4df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14740401-4887-49a6-942b-0a3adc6a4df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323773968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adf2877-3091-4058-ae42-c39e8311b13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:34Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040ccdee-e3e6-45db-9b30-06b9729fff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040ccdee-e3e6-45db-9b30-06b9729fff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8bf789-fc8f-4165-a3ed-b1f26fd4f1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8bf789-fc8f-4165-a3ed-b1f26fd4f1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adf2877-3091-4058-ae42-c39e8311b13e', 'volume_name': 'volume-5adf2877-3091-4058-ae42-c39e8311b13e', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad872740-15bb-4b21-9325-37b3f06c7220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad872740-15bb-4b21-9325-37b3f06c7220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f533e2a-dfcb-4ff2-92fa-efa3fd7bcead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:34 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Volume 5adf2877-3091-4058-ae42-c39e8311b13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adf2877-3091-4058-ae42-c39e8311b13e', 'volume_size': 1} Jul 07 10:42:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:37 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" returned: 0 in 5.675s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c53793-d1a3-498e-a474-70ab875b118a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:37 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 Jul 07 10:42:37 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:38 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" returned: 0 in 1.054s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:38 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:42:38 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Converted 1024.00 MB image at 180.43 MB/s Jul 07 10:42:38 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:42:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:38 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e Jul 07 10:42:38 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:39 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" returned: 0 in 0.672s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" released by "_copy_volume_from_snapshot" :: held 9.243s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-8db4dd57-ac44-458e-943a-88da4d185227-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" released by "_create_volume_from_snapshot" :: held 9.333s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.373s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.116s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323773968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adf2877-3091-4058-ae42-c39e8311b13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:34Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Creating volume 5adf2877-3091-4058-ae42-c39e8311b13e {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:39 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:39 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e 1073741824 Jul 07 10:42:39 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-20586d68-4b4f-4bf6-be60-938b409c0c88 tempest-GroupSnapshotsTest-29473418 None] Create group from source-snapshot-114ed428-8c21-4bc8-824f-2c9d83a70243 completed successfully. Jul 07 10:42:40 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e 1073741824" returned: 0 in 1.009s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:40 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e Jul 07 10:42:40 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03b84bf-1c68-4201-a0fe-2a3a17d85390]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:40 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e Jul 07 10:42:40 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:40 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e" returned: 0 in 0.716s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f533e2a-dfcb-4ff2-92fa-efa3fd7bcead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adf2877-3091-4058-ae42-c39e8311b13e', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509a278-45d1-49e8-b4b6-873e5a153a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Volume volume-5adf2877-3091-4058-ae42-c39e8311b13e (5adf2877-3091-4058-ae42-c39e8311b13e): created successfully Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509a278-45d1-49e8-b4b6-873e5a153a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (cf53af97-e245-4a70-ac76-f2a96050aec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-507ebecf-7b60-40f0-9394-0641a5a983ff tempest-VolumesActionsTest-412707665 None] Created volume successfully. Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-5adf2877-3091-4058-ae42-c39e8311b13e-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-5adf2877-3091-4058-ae42-c39e8311b13e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "cinder-quobyte-5adf2877-3091-4058-ae42-c39e8311b13e" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-5adf2877-3091-4058-ae42-c39e8311b13e" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[64500717-f3b5-462c-bcbe-9068a92ac571]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:41 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" returned: 0 in 0.883s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:41 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e Jul 07 10:42:41 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:41 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e Jul 07 10:42:41 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:42 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" returned: 0 in 0.708s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-ae504539-0cda-4c45-9c4f-e6c9c5c92f9e" released by "delete_volume" :: held 1.637s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:42 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:42 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['a82926ec-c8e1-4f6b-a6a6-34598cf68fce'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:42 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:42 devstack cinder-volume[87208]: WARNING cinder.quota [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1632649078 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1632649078, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:42:42 devstack cinder-volume[87208]: WARNING cinder.quota [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1632649078 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1632649078, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['b7d370b9-c024-4e9c-9f5a-bd904721da55', '94039b60-384d-4370-a0f4-9845984f2dab', 'ba32a59c-a66b-42e6-91f7-37d58a36045b', 'f5a2c686-695b-45d0-833e-d6488b75e49d'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:42 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:42 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:43 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5adf2877-3091-4058-ae42-c39e8311b13e" returned: 0 in 0.752s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-quobyte-5adf2877-3091-4058-ae42-c39e8311b13e" released by "delete_volume" :: held 1.670s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] group_snapshot 114ed428-8c21-4bc8-824f-2c9d83a70243: deleting Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] group_snapshot 114ed428-8c21-4bc8-824f-2c9d83a70243: deleting {{(pid=87208) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Created reservations ['304a9218-1baa-405c-a07f-5c72f72bc70f', '97b62fa6-9346-484d-a7d8-769ea4841fd2', 'bd0eac0b-f195-4478-89f2-2523fabda377', '0518bf3f-3878-41df-ad40-3a0e9a3b8995'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-8db4dd57-ac44-458e-943a-88da4d185227" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:43 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.754s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-8db4dd57-ac44-458e-943a-88da4d185227" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Deleting offline snapshot 8db4dd57-ac44-458e-943a-88da4d185227 of volume 94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] snapshot_file for this snap is: volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:42:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6509d123-21db-43e4-852e-557748449ba8 tempest-GroupSnapshotsTest-29473418 None] Delete group completed successfully. Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3bdf0d-740c-41b2-a4ee-2c7c155870c4]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:43 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:43 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:43 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 Jul 07 10:42:43 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:44 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.901s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:44 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Deleted volume successfully. Jul 07 10:42:44 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227" returned: 0 in 0.973s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (208464b6-e56c-4e3e-82f1-0367aa25f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496de5ac-a773-4de0-bc81-2041786fb642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaace7a1-8d32-4908-915b-9971e3834385]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496de5ac-a773-4de0-bc81-2041786fb642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389412091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731370d3-61a5-4d2e-a55f-8c841a5b89d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:44Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda755f9-a585-45b3-b51e-1554c029d17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda755f9-a585-45b3-b51e-1554c029d17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b67f4c-38d7-4162-8ecd-e41160f1ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b67f4c-38d7-4162-8ecd-e41160f1ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731370d3-61a5-4d2e-a55f-8c841a5b89d7', 'volume_name': 'volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dad875-f229-47fd-b940-730a68096417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dad875-f229-47fd-b940-730a68096417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd35a4eb-b15e-4181-96b9-1fd3617958a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:44 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Volume 731370d3-61a5-4d2e-a55f-8c841a5b89d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7', 'volume_size': 1} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389412091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731370d3-61a5-4d2e-a55f-8c841a5b89d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e0f2a0c145a28ff16649525f972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:44Z,use_quota=True,user_id='166c488d48e4453c919ac14d75fa5af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Creating volume 731370d3-61a5-4d2e-a55f-8c841a5b89d7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:44 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-52ecf719-4473-4089-887e-ece0476812b0 tempest-VolumesActionsTest-2146496310 None] Lock "cinder-5adf2877-3091-4058-ae42-c39e8311b13e-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:44 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 1073741824 Jul 07 10:42:44 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:44 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 Jul 07 10:42:44 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:45 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:45 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 Jul 07 10:42:45 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:45 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 1073741824" returned: 0 in 0.834s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:45 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 Jul 07 10:42:45 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:46 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd35a4eb-b15e-4181-96b9-1fd3617958a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:46 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca1ad57-dd09-4abe-b879-db2c2dab13cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227" returned: 0 in 0.979s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:46 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Volume volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 (731370d3-61a5-4d2e-a55f-8c841a5b89d7): created successfully Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca1ad57-dd09-4abe-b879-db2c2dab13cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:46 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227 Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Flow 'volume_create_manager' (208464b6-e56c-4e3e-82f1-0367aa25f294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:46 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:46 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-575f42ad-4275-4b73-8d48-dd08ba839d1f tempest-VolumesActionsTest-412707665 None] Created volume successfully. Jul 07 10:42:46 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7.8db4dd57-ac44-458e-943a-88da4d185227" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-8db4dd57-ac44-458e-943a-88da4d185227" released by "_delete_snapshot" :: held 3.643s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" released by "delete_snapshot" :: held 3.688s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:47 devstack cinder-volume[87208]: WARNING cinder.quota [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1632649078 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1632649078, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['8fb8332e-983a-4284-9428-9e0b461fc0f1', '3fd0a941-0b10-41b3-8b67-15a4144b334b', '7a62b3f4-2b17-4c85-8db7-28609eecfc8d', '91e15b20-dc2e-4aa3-b5a2-41cefc9d3534'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Acquiring lock "cinder-731370d3-61a5-4d2e-a55f-8c841a5b89d7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Lock "cinder-731370d3-61a5-4d2e-a55f-8c841a5b89d7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Acquiring lock "cinder-quobyte-731370d3-61a5-4d2e-a55f-8c841a5b89d7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-22b591be-2d21-40a7-8abb-65f28c7c0979 tempest-GroupSnapshotsTest-29473418 None] group_snapshot 114ed428-8c21-4bc8-824f-2c9d83a70243: deleted successfully Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Lock "cinder-quobyte-731370d3-61a5-4d2e-a55f-8c841a5b89d7" acquired by "delete_volume" :: waited 0.033s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[189db741-7485-401e-b90d-a8025525097e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:47 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 Jul 07 10:42:47 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:42:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:42:48 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[caec2521-7295-45ec-8618-8cbcfd18b77c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:42:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:48 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 Jul 07 10:42:48 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:48 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7" returned: 0 in 1.002s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:48 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7 Jul 07 10:42:48 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:49 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-731370d3-61a5-4d2e-a55f-8c841a5b89d7" returned: 0 in 0.712s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Lock "cinder-quobyte-731370d3-61a5-4d2e-a55f-8c841a5b89d7" released by "delete_volume" :: held 1.767s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:49 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" returned: 0 in 0.943s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:49 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7 Jul 07 10:42:49 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Created reservations ['8cca9dc0-e89b-421c-8591-62a7209c889a', 'b03a8429-e6b3-48e6-995b-586fe161e0ae', 'd52dbc18-506f-420b-97fc-cb29142f29d0', 'c33ec90a-be42-47f7-a643-e55275651e01'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:49 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:49 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:49 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" returned: 0 in 0.752s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-94a70c30-dbd8-4b91-ae00-e32d3dd961c7" released by "delete_volume" :: held 1.790s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Created reservations ['f2770f39-fc48-4eeb-9aa5-83013f002745'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:49 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.753s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:49 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Deleted volume successfully. Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-18caa422-3e20-4a4f-acac-d9b4ede27322 tempest-VolumesActionsTest-412707665 None] Lock "cinder-731370d3-61a5-4d2e-a55f-8c841a5b89d7-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:42:50 devstack cinder-volume[87208]: WARNING cinder.db.api [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1632649078'] Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Created reservations ['331d8e20-636d-4c1b-9e66-eb028e7cbb5a', 'c52aa44a-e582-4e04-80db-97ec1fd69145', '1d61d1c1-70ed-4f52-bea4-d07ae77a9e0e', '59e8b03b-191f-4479-9566-23e100d6b3e3'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:50 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:42:50 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:50 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.839s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:50 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:42:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0d43795d-02af-482b-b374-4190cfc3f23c tempest-GroupSnapshotsTest-29473418 None] Delete group completed successfully. Jul 07 10:42:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5930187d-45ba-41c3-8aca-a9c70026cbbe tempest-GroupSnapshotsTest-29473418 None] Group tempest-GroupSnapshotsTest-Group-32710903: creating Jul 07 10:42:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5930187d-45ba-41c3-8aca-a9c70026cbbe tempest-GroupSnapshotsTest-29473418 None] Group tempest-GroupSnapshotsTest-Group-32710903: created successfully Jul 07 10:42:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5930187d-45ba-41c3-8aca-a9c70026cbbe tempest-GroupSnapshotsTest-29473418 None] Create group completed successfully. Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (80938d91-9214-4ebb-b7e8-3890a258ca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf5d377-4721-422c-89b9-c80d2c0f483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf5d377-4721-422c-89b9-c80d2c0f483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619808582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2622c251-9396-4654-9816-d51e92c66159,host='devstack@QuobyteHD#QuobyteHD',id=1a30c59e-44ed-43a6-a2e5-ee3962e80b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:53Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c078838-a325-458e-a513-699ab967053d),volume_type_id=2c078838-a325-458e-a513-699ab967053d)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfa50bd-dcf2-4c35-84e5-ea17f2b3ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfa50bd-dcf2-4c35-84e5-ea17f2b3ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab10ac5c-5021-4ccc-b03b-c9e1de5c10d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab10ac5c-5021-4ccc-b03b-c9e1de5c10d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a30c59e-44ed-43a6-a2e5-ee3962e80b0f', 'volume_name': 'volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9926c6d8-b4b0-4b3c-9a62-8bc844e4d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9926c6d8-b4b0-4b3c-9a62-8bc844e4d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54996503-0d4f-40a5-8ec5-e4e830b1b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:52 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Volume 1a30c59e-44ed-43a6-a2e5-ee3962e80b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f', 'volume_size': 1} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2622c251-9396-4654-9816-d51e92c66159,created_at=2026-07-07T08:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619808582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2622c251-9396-4654-9816-d51e92c66159,host='devstack@QuobyteHD#QuobyteHD',id=1a30c59e-44ed-43a6-a2e5-ee3962e80b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:53Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c078838-a325-458e-a513-699ab967053d),volume_type_id=2c078838-a325-458e-a513-699ab967053d)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Creating volume 1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:52 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:52 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f 1073741824 Jul 07 10:42:52 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:53 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f 1073741824" returned: 0 in 1.027s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:54 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f Jul 07 10:42:54 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:54 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" returned: 0 in 0.801s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54996503-0d4f-40a5-8ec5-e4e830b1b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd89ae82-ddc6-4985-8658-588545369607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:54 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Volume volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f (1a30c59e-44ed-43a6-a2e5-ee3962e80b0f): created successfully Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd89ae82-ddc6-4985-8658-588545369607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (80938d91-9214-4ebb-b7e8-3890a258ca27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-dc8a01fb-ba97-47eb-ab18-9faa30cdde58 tempest-GroupSnapshotsTest-29473418 None] Created volume successfully. Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (3a386ea4-e70c-491f-82ba-8cea3bb52652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd89c383-756e-4a27-99b8-249b9653d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd89c383-756e-4a27-99b8-249b9653d571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580896499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2622c251-9396-4654-9816-d51e92c66159,host='devstack@QuobyteHD#QuobyteHD',id=b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:56Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c078838-a325-458e-a513-699ab967053d),volume_type_id=2c078838-a325-458e-a513-699ab967053d)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad0e3c2-be02-4545-b741-d56d2ad562a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad0e3c2-be02-4545-b741-d56d2ad562a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d3f5a0-81c6-4f6e-9468-03e2a9d84345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d3f5a0-81c6-4f6e-9468-03e2a9d84345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60', 'volume_name': 'volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3789967-2000-4b1d-8a52-17c2d8beabe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3789967-2000-4b1d-8a52-17c2d8beabe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d397e3a2-d6b4-41a2-b4ea-364eedabcfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Volume b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60', 'volume_size': 1} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2622c251-9396-4654-9816-d51e92c66159,created_at=2026-07-07T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580896499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2622c251-9396-4654-9816-d51e92c66159,host='devstack@QuobyteHD#QuobyteHD',id=b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:42:56Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c078838-a325-458e-a513-699ab967053d),volume_type_id=2c078838-a325-458e-a513-699ab967053d)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Creating volume b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:42:55 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:42:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:55 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 1073741824 Jul 07 10:42:55 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:56 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 1073741824" returned: 0 in 0.849s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:42:56 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 Jul 07 10:42:56 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:42:57 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 07 10:42:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" returned: 0 in 0.691s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:42:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:42:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:42:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d397e3a2-d6b4-41a2-b4ea-364eedabcfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4943f07e-6c30-472b-8b5b-08d08f5dfa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:42:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Volume volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 (b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60): created successfully Jul 07 10:42:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4943f07e-6c30-472b-8b5b-08d08f5dfa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:42:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (3a386ea4-e70c-491f-82ba-8cea3bb52652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:42:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c6d98fc3-d226-42fa-b782-9cd2f8bc3faf tempest-GroupSnapshotsTest-29473418 None] Created volume successfully. Jul 07 10:42:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-dcd9a874-fef1-4bc9-929a-f7518a0b10c8 tempest-GroupSnapshotsTest-29473418 None] Update group completed successfully. Jul 07 10:42:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8df47a0f-27f0-474a-a34a-209eba49333f tempest-GroupSnapshotsTest-29473418 None] Update group completed successfully. Jul 07 10:43:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2308babf-56d1-49ee-be2a-a36773f38028 tempest-GroupSnapshotsTest-29473418 None] Update group completed successfully. Jul 07 10:43:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5fd56c3d-9d4a-4a71-a9f6-02c50172c51a tempest-GroupSnapshotsTest-29473418 None] Update group completed successfully. Jul 07 10:43:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] GroupSnapshot 74d22bab-1a53-4c87-ac06-af6dd1d845c8: creating. Jul 07 10:43:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Group snapshot 74d22bab-1a53-4c87-ac06-af6dd1d845c8: creating. {{(pid=87208) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 10:43:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Creating offline snapshot 45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 of volume b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:43:03 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e16a42-df07-41a8-96b1-fc9a035ad334]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:03 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 Jul 07 10:43:03 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:04 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" returned: 0 in 0.812s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:04 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 1G Jul 07 10:43:04 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Flow 'volume_create_manager' (b3dcf38d-dbf6-46bb-8b2b-f0717735db38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1ebefa-7bc6-4be7-a97f-599f122f15db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1ebefa-7bc6-4be7-a97f-599f122f15db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-366056873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50d858b-abb6-40e2-93c6-9324cce30448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205ef058634a46feaa063c5de6af85fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:05Z,use_quota=True,user_id='5ee81700b5494e00a563b20c1470660e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208d3608-d4a5-4334-919a-4c744edfc882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208d3608-d4a5-4334-919a-4c744edfc882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6618a9-8732-4cf5-bbc7-0893e89a552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6618a9-8732-4cf5-bbc7-0893e89a552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50d858b-abb6-40e2-93c6-9324cce30448', 'volume_name': 'volume-e50d858b-abb6-40e2-93c6-9324cce30448', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52511fbc-4f41-4cec-9cb9-829c3f115f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52511fbc-4f41-4cec-9cb9-829c3f115f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d401ae1-3683-40d2-8664-cdbefac421a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:05 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Volume e50d858b-abb6-40e2-93c6-9324cce30448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50d858b-abb6-40e2-93c6-9324cce30448', 'volume_size': 1} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:05 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 1G" returned: 0 in 0.899s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:05 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 Jul 07 10:43:05 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:06 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" returned: 0 in 0.722s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:06 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:43:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:06 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 Jul 07 10:43:06 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:06 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" returned: 0 in 0.785s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:06 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.info Jul 07 10:43:06 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:07 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.info" returned: 0 in 0.790s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:07 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:43:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:07 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.info Jul 07 10:43:07 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:08 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.info" returned: 0 in 0.678s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.794s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Creating offline snapshot 618897f7-bfb2-4c79-bddc-06e48341459d of volume 1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:43:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe352bb7-adfb-46e7-952b-081c7d89a241]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:08 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f Jul 07 10:43:08 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:09 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" returned: 0 in 0.759s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:09 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d 1G Jul 07 10:43:09 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:10 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d 1G" returned: 0 in 0.874s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:10 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d Jul 07 10:43:10 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:10 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d" returned: 0 in 0.767s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:10 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:43:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:10 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d Jul 07 10:43:10 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:11 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d" returned: 0 in 0.748s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:11 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.info Jul 07 10:43:11 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Flow 'volume_create_manager' (006d13a4-f6b2-4819-bb87-24700fb6034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52bced7-5ebc-46e0-9816-16287ff91f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52bced7-5ebc-46e0-9816-16287ff91f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2008962195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdfc64e-b8f5-4fed-b1e4-3462439f6ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c425ecad1248c4a258cd41420e2317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:12Z,use_quota=True,user_id='25a8956c4cb34b9a9395ed1f34c6217c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df54010-5a48-4237-abe0-69b476fb98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df54010-5a48-4237-abe0-69b476fb98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9adefd7-d77d-43f3-bc8b-50fb081bd84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9adefd7-d77d-43f3-bc8b-50fb081bd84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abdfc64e-b8f5-4fed-b1e4-3462439f6ae8', 'volume_name': 'volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026e646a-79a1-4c4d-a0da-cf5964b231f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026e646a-79a1-4c4d-a0da-cf5964b231f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47edffa0-7708-4639-9854-b961b40d9f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:12 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Volume abdfc64e-b8f5-4fed-b1e4-3462439f6ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8', 'volume_size': 1} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:12 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.info" returned: 0 in 0.728s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:12 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:12 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.info Jul 07 10:43:12 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:12 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.info" returned: 0 in 0.639s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.602s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.673s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-366056873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50d858b-abb6-40e2-93c6-9324cce30448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205ef058634a46feaa063c5de6af85fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:05Z,use_quota=True,user_id='5ee81700b5494e00a563b20c1470660e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Creating volume e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:43:13 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:43:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:13 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 1073741824 Jul 07 10:43:13 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-92cc6f5b-4639-4325-9f3e-9ba2996823b0 tempest-GroupSnapshotsTest-29473418 None] group_snapshot 74d22bab-1a53-4c87-ac06-af6dd1d845c8: created successfully Jul 07 10:43:13 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 1073741824" returned: 0 in 0.836s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:13 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 Jul 07 10:43:13 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] group_snapshot 74d22bab-1a53-4c87-ac06-af6dd1d845c8: deleting Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] group_snapshot 74d22bab-1a53-4c87-ac06-af6dd1d845c8: deleting {{(pid=87208) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Deleting offline snapshot 45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 of volume b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] snapshot_file for this snap is: volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a92f748-324c-4503-950c-f4cbc24c960d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:14 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 Jul 07 10:43:14 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:14 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2008962195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdfc64e-b8f5-4fed-b1e4-3462439f6ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c425ecad1248c4a258cd41420e2317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:12Z,use_quota=True,user_id='25a8956c4cb34b9a9395ed1f34c6217c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Creating volume abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:43:14 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:14 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 1073741824 Jul 07 10:43:14 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d401ae1-3683-40d2-8664-cdbefac421a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50d858b-abb6-40e2-93c6-9324cce30448', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a10929f-a84e-4277-a58c-daeae5c26bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:14 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Volume volume-e50d858b-abb6-40e2-93c6-9324cce30448 (e50d858b-abb6-40e2-93c6-9324cce30448): created successfully Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a10929f-a84e-4277-a58c-daeae5c26bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Flow 'volume_create_manager' (b3dcf38d-dbf6-46bb-8b2b-f0717735db38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2eac6452-2704-495f-b9d4-d3faec89c1a0 tempest-SnapshotMetadataTestJSON-2140337751 None] Created volume successfully. Jul 07 10:43:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:15 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" returned: 0 in 0.962s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:15 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbba770-3ccc-4355-badc-205f3a4957a6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:15 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 Jul 07 10:43:15 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:15 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 1073741824" returned: 0 in 0.910s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:15 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 Jul 07 10:43:15 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:16 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" returned: 0 in 0.801s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:16 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 Jul 07 10:43:16 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:16 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8" returned: 0 in 0.675s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.136s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Creating offline snapshot aaf623c5-45ed-4d71-bac1-6039ef7a6b4d of volume e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47edffa0-7708-4639-9854-b961b40d9f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966a9133-1895-4ce8-b0c1-0b67a98c292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c38b603-365b-4b0d-9ac1-8e33a05faf32]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:16 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Volume volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 (abdfc64e-b8f5-4fed-b1e4-3462439f6ae8): created successfully Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966a9133-1895-4ce8-b0c1-0b67a98c292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Flow 'volume_create_manager' (006d13a4-f6b2-4819-bb87-24700fb6034f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c566813e-6825-42ce-9265-2b9e87a6ffe7 tempest-TestMinimumBasicScenario-151003491 None] Created volume successfully. Jul 07 10:43:16 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 Jul 07 10:43:16 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:16 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" returned: 0 in 0.770s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:16 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60 Jul 07 10:43:16 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:17 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448" returned: 0 in 0.869s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:17 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d 1G Jul 07 10:43:17 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:17 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60.45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" returned: 0 in 0.699s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-45ecfb2d-8eba-47b7-a40b-68abe3c6cb60" released by "_delete_snapshot" :: held 3.376s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" released by "delete_snapshot" :: held 3.411s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-618897f7-bfb2-4c79-bddc-06e48341459d" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-618897f7-bfb2-4c79-bddc-06e48341459d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Deleting offline snapshot 618897f7-bfb2-4c79-bddc-06e48341459d of volume 1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] snapshot_file for this snap is: volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[024c75fa-cb3d-472a-9b4f-bd933ec9e438]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:17 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d Jul 07 10:43:17 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:18 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d 1G" returned: 0 in 0.912s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e50d858b-abb6-40e2-93c6-9324cce30448 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:18 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e50d858b-abb6-40e2-93c6-9324cce30448 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d Jul 07 10:43:18 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:18 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d" returned: 0 in 0.828s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4b84c9-090d-4ba0-94be-41bc34cca56e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:18 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:18 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f Jul 07 10:43:18 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e50d858b-abb6-40e2-93c6-9324cce30448 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" returned: 0 in 0.725s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:18 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d is being set with open permissions: ugo+rw Jul 07 10:43:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:18 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d Jul 07 10:43:18 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:19 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" returned: 0 in 0.638s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:19 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:19 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.info Jul 07 10:43:19 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:19 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d Jul 07 10:43:19 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:20 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.info" returned: 0 in 0.765s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:20 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.info is being set with open permissions: ugo+rw Jul 07 10:43:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:20 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.info Jul 07 10:43:20 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:20 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d" returned: 0 in 0.850s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:20 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d Jul 07 10:43:20 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-cec9839c-0fc4-4847-9ca3-3cc858bd37bf req-11d8ada1-0abe-4fe5-87a3-5b9ce6112794 tempest-TestMinimumBasicScenario-151003491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:20 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.info" returned: 0 in 0.721s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.749s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-cec9839c-0fc4-4847-9ca3-3cc858bd37bf req-11d8ada1-0abe-4fe5-87a3-5b9ce6112794 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.086s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eabbe7a-1ad9-4154-b6db-f38a0c4e6c52]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-cec9839c-0fc4-4847-9ca3-3cc858bd37bf req-11d8ada1-0abe-4fe5-87a3-5b9ce6112794 tempest-TestMinimumBasicScenario-151003491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c1759a97-a2d0-4223-b885-9be54948a1e1 tempest-SnapshotMetadataTestJSON-2140337751 None] Create snapshot completed successfully Jul 07 10:43:21 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f.618897f7-bfb2-4c79-bddc-06e48341459d" returned: 0 in 0.753s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-618897f7-bfb2-4c79-bddc-06e48341459d" released by "_delete_snapshot" :: held 3.389s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:21 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 Jul 07 10:43:21 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" released by "delete_snapshot" :: held 3.425s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:21 devstack cinder-volume[87208]: WARNING cinder.quota [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-857849677 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-857849677, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:43:21 devstack cinder-volume[87208]: WARNING cinder.quota [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-857849677 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-857849677, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Created reservations ['21a77828-19a0-4080-8078-ed0ba2e1d774', '4947198e-86a6-4a0a-829b-0acd50833da3', '5ff7b834-ef8b-45af-be45-47db638526bd', '576cd437-371f-43ec-ab44-5b34093d5784'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] Created reservations ['3e38daec-d6f6-4e2d-8a32-4bb3f4c5388d', 'f8794cf7-4504-4da2-b629-dc1f65b206b6', '67317bda-1fa7-491e-9bdf-7f478234fce3', 'de307d6a-4d0e-4a07-bd3c-20b0faf04f6a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6f9e2d72-80f9-4266-818b-c9422afc62ec tempest-GroupSnapshotsTest-29473418 None] group_snapshot 74d22bab-1a53-4c87-ac06-af6dd1d845c8: deleted successfully Jul 07 10:43:21 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-cec9839c-0fc4-4847-9ca3-3cc858bd37bf req-11d8ada1-0abe-4fe5-87a3-5b9ce6112794 tempest-TestMinimumBasicScenario-151003491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8" returned: 0 in 0.872s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-cec9839c-0fc4-4847-9ca3-3cc858bd37bf req-11d8ada1-0abe-4fe5-87a3-5b9ce6112794 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-cec9839c-0fc4-4847-9ca3-3cc858bd37bf req-11d8ada1-0abe-4fe5-87a3-5b9ce6112794 tempest-TestMinimumBasicScenario-151003491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed507950-c626-48d7-8b05-1a197fe7d6df', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:43:22 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-cec9839c-0fc4-4847-9ca3-3cc858bd37bf req-11d8ada1-0abe-4fe5-87a3-5b9ce6112794 tempest-TestMinimumBasicScenario-151003491 None] attachment_update completed successfully. Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "cinder-aaf623c5-45ed-4d71-bac1-6039ef7a6b4d-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-aaf623c5-45ed-4d71-bac1-6039ef7a6b4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "cinder-quobyte-e50d858b-abb6-40e2-93c6-9324cce30448" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" acquired by "delete_volume" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f29c82-9c36-4a15-a09f-a0dd1ab17e90]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-quobyte-e50d858b-abb6-40e2-93c6-9324cce30448" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "cinder-quobyte-aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-quobyte-aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Deleting offline snapshot aaf623c5-45ed-4d71-bac1-6039ef7a6b4d of volume e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] snapshot_file for this snap is: volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8450c9d3-8531-4df8-a1da-deb051f771de]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:22 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f Jul 07 10:43:22 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:22 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d Jul 07 10:43:22 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:23 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" returned: 0 in 0.818s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:23 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f Jul 07 10:43:23 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:23 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" returned: 0 in 0.783s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e50d858b-abb6-40e2-93c6-9324cce30448(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[81df23f5-9132-4ad9-ac49-507e5ed565ff]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:23 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 Jul 07 10:43:23 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:23 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:43:23 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:24 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" returned: 0 in 0.727s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-1a30c59e-44ed-43a6-a2e5-ee3962e80b0f" released by "delete_volume" :: held 1.633s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450fa84-d043-4e38-ab36-d2606ad7fc1c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:24 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.674s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:43:24 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448" returned: 0 in 0.789s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:24 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 Jul 07 10:43:24 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:24 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d Jul 07 10:43:24 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:25 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" returned: 0 in 0.792s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:25 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60 Jul 07 10:43:25 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:25 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" returned: 0 in 0.752s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:25 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d Jul 07 10:43:25 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:25 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-b04e1e3d-ce8c-4ed2-9988-7859a2b2ed60" released by "delete_volume" :: held 1.515s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:25 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448.aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" returned: 0 in 0.670s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-quobyte-aaf623c5-45ed-4d71-bac1-6039ef7a6b4d" released by "_delete_snapshot" :: held 3.129s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-quobyte-e50d858b-abb6-40e2-93c6-9324cce30448" released by "delete_snapshot" :: held 3.171s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['508e9ed9-546a-43ba-a49d-b8bbd48a5599'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:25 devstack cinder-volume[87208]: WARNING cinder.quota [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-857849677 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-857849677, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Created reservations ['922caae0-f3c2-4b14-9f80-71cb091155a0', '64b027a8-4174-4d3f-8591-0df3670eedd7', '23c3b0b7-aa9c-4051-ba4c-c28606d9476e', 'f93950d7-607b-4f8f-aac1-f0aaee4d51f5'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['dace8493-d458-44f4-b129-d8e057017546', '87254e26-da3a-41b4-b0ab-93eae539f4e4', 'ede49ef0-e5be-49c1-bb9d-71415e2e9d4f', 'f72bf039-007d-42b4-b7ac-78cf72b958bb'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:25 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Delete snapshot completed successfully. Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-825c39e6-84dc-4699-bb3b-9d247e29a828 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-aaf623c5-45ed-4d71-bac1-6039ef7a6b4d-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['5bcb1c07-b547-45c0-902e-b307ac2a4c8e', '58a88920-7d7a-4305-8293-6459187843b8', '2ae046ec-1cea-48a4-a1e7-b95d40bdb2f2', '36aec795-4c34-47df-93a1-bbd3019a34a0'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:26 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:43:26 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:26 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.656s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:43:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-411de986-5871-424b-976c-acbd22727919 tempest-GroupSnapshotsTest-29473418 None] Delete group completed successfully. Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "cinder-e50d858b-abb6-40e2-93c6-9324cce30448-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-e50d858b-abb6-40e2-93c6-9324cce30448-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "cinder-quobyte-e50d858b-abb6-40e2-93c6-9324cce30448" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-quobyte-e50d858b-abb6-40e2-93c6-9324cce30448" acquired by "delete_volume" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5edfe0d-b8d3-4d23-82e0-84476017ecea]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:27 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 Jul 07 10:43:27 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-259dadb9-1c1b-428a-8aa9-af01234ab1ec tempest-GroupSnapshotsTest-29473418 None] Group tempest-GroupSnapshotsTest-Group-1943746397: creating Jul 07 10:43:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-259dadb9-1c1b-428a-8aa9-af01234ab1ec tempest-GroupSnapshotsTest-29473418 None] Group tempest-GroupSnapshotsTest-Group-1943746397: created successfully Jul 07 10:43:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-259dadb9-1c1b-428a-8aa9-af01234ab1ec tempest-GroupSnapshotsTest-29473418 None] Create group completed successfully. Jul 07 10:43:27 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448" returned: 0 in 0.824s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:27 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448 Jul 07 10:43:27 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:28 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e50d858b-abb6-40e2-93c6-9324cce30448" returned: 0 in 0.715s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-quobyte-e50d858b-abb6-40e2-93c6-9324cce30448" released by "delete_volume" :: held 1.603s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Created reservations ['4e466b4e-7698-443c-aa42-dc50bc426d56', '4df1a743-4ae9-45ce-aad2-8ca675c0cc26', '5a8d58b7-08cf-46e8-aaf1-b008da35cbd8', 'd1c7ae8d-e43b-444c-a93a-cab6cbf3b9d4'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:28 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:43:28 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (5d710d42-0ccf-4468-b5cc-e16cbfc779e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b44d46-073d-4dbd-8425-a1c5bd6742d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:29 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b44d46-073d-4dbd-8425-a1c5bd6742d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228566698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8305d8f8-7f1a-478c-9d53-3b76f05c0d12,host='devstack@QuobyteHD#QuobyteHD',id=9f7c9608-45e8-4073-8abf-6a76aa1393b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:29Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f30aea93-8571-4130-9e6d-50fb526e0cef),volume_type_id=f30aea93-8571-4130-9e6d-50fb526e0cef)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b404ee72-991b-4fbc-8030-1ad99d7230b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b404ee72-991b-4fbc-8030-1ad99d7230b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24249cbb-c73c-4d03-90f3-b59cd0e285ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24249cbb-c73c-4d03-90f3-b59cd0e285ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7c9608-45e8-4073-8abf-6a76aa1393b0', 'volume_name': 'volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1acdca-d4ec-4c27-9f56-051aa72c0308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1acdca-d4ec-4c27-9f56-051aa72c0308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5650bf7e-43b6-4002-bbd8-8d0f4ac45c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:29 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Volume 9f7c9608-45e8-4073-8abf-6a76aa1393b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0', 'volume_size': 1} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8305d8f8-7f1a-478c-9d53-3b76f05c0d12,created_at=2026-07-07T08:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228566698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8305d8f8-7f1a-478c-9d53-3b76f05c0d12,host='devstack@QuobyteHD#QuobyteHD',id=9f7c9608-45e8-4073-8abf-6a76aa1393b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f30478f3ee348349d3edd2b88a75240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:29Z,use_quota=True,user_id='b059929ef4524a1ea5544e562574ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f30aea93-8571-4130-9e6d-50fb526e0cef),volume_type_id=f30aea93-8571-4130-9e6d-50fb526e0cef)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Creating volume 9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:43:29 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.152s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:43:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Deleted volume successfully. Jul 07 10:43:29 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 1073741824 Jul 07 10:43:29 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bd8fc4b9-6e99-490e-8e2f-e8f25ed61d60 tempest-SnapshotMetadataTestJSON-2140337751 None] Lock "cinder-e50d858b-abb6-40e2-93c6-9324cce30448-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:30 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 1073741824" returned: 0 in 1.193s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:31 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 Jul 07 10:43:31 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:31 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0" returned: 0 in 0.731s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5650bf7e-43b6-4002-bbd8-8d0f4ac45c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907090aa-a596-4fbe-a637-f82ad386d7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:31 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Volume volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 (9f7c9608-45e8-4073-8abf-6a76aa1393b0): created successfully Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907090aa-a596-4fbe-a637-f82ad386d7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Flow 'volume_create_manager' (5d710d42-0ccf-4468-b5cc-e16cbfc779e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-337cc990-5774-44db-82bb-15173aa30a2b tempest-GroupSnapshotsTest-29473418 None] Created volume successfully. Jul 07 10:43:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] GroupSnapshot bacbab49-2584-47f5-be71-18819523b87e: creating. Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=125,cinder:SELECT=117,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=117,cinder:INSERT=34,cinder:UPDATE=135,cinder:DELETE=6 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Group snapshot bacbab49-2584-47f5-be71-18819523b87e: creating. {{(pid=87208) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Creating offline snapshot 0431c388-e055-4e2a-9529-df552193df42 of volume 9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0836f6-d586-43b8-8c44-c3d3c7511f39]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:33 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 Jul 07 10:43:33 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:34 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0" returned: 0 in 0.919s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:34 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 1G Jul 07 10:43:34 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:35 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 1G" returned: 0 in 0.950s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:35 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 Jul 07 10:43:35 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Flow 'volume_create_manager' (d1df0913-5c68-4f6b-98ee-fe5630231e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15edbea5-4044-4fec-963c-e58d37e97ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15edbea5-4044-4fec-963c-e58d37e97ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1505828847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90db1da-1883-4abe-bc6f-2104e4732529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8689f3239384dd281f3c0f9f4f530a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:35Z,use_quota=True,user_id='3d0cef77c3034202b346e43b95531004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8601f8a-b146-482a-acfe-8d3184893994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8601f8a-b146-482a-acfe-8d3184893994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688a9f4c-3104-403d-ab7a-d1dae9dd272b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688a9f4c-3104-403d-ab7a-d1dae9dd272b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90db1da-1883-4abe-bc6f-2104e4732529', 'volume_name': 'volume-f90db1da-1883-4abe-bc6f-2104e4732529', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344e983a-afcb-4466-b77d-6a44756ca287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344e983a-afcb-4466-b77d-6a44756ca287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0492ee79-5d77-44d4-9d4c-14311dd4d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:35 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Volume f90db1da-1883-4abe-bc6f-2104e4732529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90db1da-1883-4abe-bc6f-2104e4732529', 'volume_size': 1} Jul 07 10:43:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:36 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42" returned: 0 in 0.705s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:36 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:43:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:36 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 Jul 07 10:43:36 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:36 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42" returned: 0 in 0.634s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:36 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.info Jul 07 10:43:36 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:37 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.info" returned: 0 in 0.656s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:37 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 10:43:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:37 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.info Jul 07 10:43:37 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:38 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.info" returned: 0 in 0.658s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.616s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.511s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1505828847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90db1da-1883-4abe-bc6f-2104e4732529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8689f3239384dd281f3c0f9f4f530a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:43:35Z,use_quota=True,user_id='3d0cef77c3034202b346e43b95531004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Creating volume f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:43:38 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:38 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 1073741824 Jul 07 10:43:38 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-85cce937-7963-43e0-9e4f-fa9d8fecbe59 tempest-GroupSnapshotsTest-29473418 None] group_snapshot bacbab49-2584-47f5-be71-18819523b87e: created successfully Jul 07 10:43:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] group_snapshot bacbab49-2584-47f5-be71-18819523b87e: deleting Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] group_snapshot bacbab49-2584-47f5-be71-18819523b87e: deleting {{(pid=87208) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-9f7c9608-45e8-4073-8abf-6a76aa1393b0" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:38 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 1073741824" returned: 0 in 0.869s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-9f7c9608-45e8-4073-8abf-6a76aa1393b0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-0431c388-e055-4e2a-9529-df552193df42" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-0431c388-e055-4e2a-9529-df552193df42" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Deleting offline snapshot 0431c388-e055-4e2a-9529-df552193df42 of volume 9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] snapshot_file for this snap is: volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afce782-a17a-41a2-b000-5ae4507ecb58]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:39 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 Jul 07 10:43:39 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:39 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 Jul 07 10:43:39 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:39 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0492ee79-5d77-44d4-9d4c-14311dd4d79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90db1da-1883-4abe-bc6f-2104e4732529', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d1ac43-346d-49d0-b3f9-80b0d92881b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:43:39 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Volume volume-f90db1da-1883-4abe-bc6f-2104e4732529 (f90db1da-1883-4abe-bc6f-2104e4732529): created successfully Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d1ac43-346d-49d0-b3f9-80b0d92881b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Flow 'volume_create_manager' (d1df0913-5c68-4f6b-98ee-fe5630231e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:43:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-08daf29b-562a-47f7-836d-8358457e4142 tempest-VolumesDeleteCascade-503006598 None] Created volume successfully. Jul 07 10:43:39 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42" returned: 0 in 0.770s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f8cff4-76c7-41e0-95ec-7421216bdc25]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:39 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 Jul 07 10:43:39 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:40 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:40 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 Jul 07 10:43:40 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Creating offline snapshot adb9619c-41bd-476e-921a-7f8b79e6381a of volume f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:43:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c1272d-2f99-4cbf-914b-16db2b5c1aa6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:41 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 Jul 07 10:43:41 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:41 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42" returned: 0 in 0.803s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:41 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42 Jul 07 10:43:41 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:41 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529" returned: 0 in 0.781s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:41 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a 1G Jul 07 10:43:41 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:42 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0.0431c388-e055-4e2a-9529-df552193df42" returned: 0 in 0.682s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-0431c388-e055-4e2a-9529-df552193df42" released by "_delete_snapshot" :: held 3.108s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-9f7c9608-45e8-4073-8abf-6a76aa1393b0" released by "delete_snapshot" :: held 3.140s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:42 devstack cinder-volume[87208]: WARNING cinder.quota [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-802632213 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-802632213, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:43:42 devstack cinder-volume[87208]: WARNING cinder.quota [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-802632213 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-802632213, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:43:42 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['8e274aca-528a-4529-8eb2-e4caf5b469c0', '29c397cf-4671-431b-8341-703ce23c37f2', '8c7f78ef-5ed8-40c4-a68d-694fa1b29aea', 'dc8aad76-e82c-4c9c-91fe-9c525949d932'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8c20b10a-f1c0-44fc-b32c-64dd352c8707 tempest-GroupSnapshotsTest-29473418 None] group_snapshot bacbab49-2584-47f5-be71-18819523b87e: deleted successfully Jul 07 10:43:42 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a 1G" returned: 0 in 0.825s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f90db1da-1883-4abe-bc6f-2104e4732529 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:42 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f90db1da-1883-4abe-bc6f-2104e4732529 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a Jul 07 10:43:42 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:43 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f90db1da-1883-4abe-bc6f-2104e4732529 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:43 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a is being set with open permissions: ugo+rw Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:43 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a Jul 07 10:43:43 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "cinder-quobyte-9f7c9608-45e8-4073-8abf-6a76aa1393b0" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-9f7c9608-45e8-4073-8abf-6a76aa1393b0" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[987aff02-f753-4031-9850-6b966f22c567]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:43 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 Jul 07 10:43:43 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:43 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:43 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.info Jul 07 10:43:43 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:44 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0" returned: 0 in 0.759s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:44 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0 Jul 07 10:43:44 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:44 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.info" returned: 0 in 0.642s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:44 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.info is being set with open permissions: ugo+rw Jul 07 10:43:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:44 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.info Jul 07 10:43:44 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:45 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9f7c9608-45e8-4073-8abf-6a76aa1393b0" returned: 0 in 0.708s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Lock "cinder-quobyte-9f7c9608-45e8-4073-8abf-6a76aa1393b0" released by "delete_volume" :: held 1.553s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['49d961ac-5301-4786-b90a-4ee9ee2c8898'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:45 devstack cinder-volume[87208]: WARNING cinder.quota [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-802632213 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-802632213, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Created reservations ['69f705fb-0b51-4bb0-a468-3dbbdf6cb851', 'a9c2e064-f67a-48ba-b0e1-9d4d8a2898f2', '9a47b185-8f2e-4e76-a669-065d748ec23d', '4ad763ec-082d-45ac-a06e-2ad044f3ca99'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:45 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.info" returned: 0 in 0.704s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.399s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4918a0da-7df5-41b0-9f76-886c4458f599 tempest-VolumesDeleteCascade-503006598 None] Create snapshot completed successfully Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:45 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:43:45 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:46 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.669s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:46 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:43:46 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-40c5252f-a460-40ed-8f90-84497c417ef3 tempest-GroupSnapshotsTest-29473418 None] Delete group completed successfully. Jul 07 10:43:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Creating offline snapshot 1dfc64f8-eeda-4b14-82ab-55f003efeb48 of volume f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:43:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5591e72d-c195-460a-b923-a964a0a580f8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:46 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a Jul 07 10:43:46 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:47 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a" returned: 0 in 0.882s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f90db1da-1883-4abe-bc6f-2104e4732529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:47 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 1G Jul 07 10:43:47 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:48 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 1G" returned: 0 in 1.120s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:48 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 Jul 07 10:43:48 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:49 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48" returned: 0 in 0.809s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:49 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 is being set with open permissions: ugo+rw Jul 07 10:43:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:49 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 Jul 07 10:43:49 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:49 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.621s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4bfee115-50a9-4796-a0d8-8c4df06616d7 tempest-VolumesDeleteCascade-503006598 None] Create snapshot completed successfully Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-f90db1da-1883-4abe-bc6f-2104e4732529-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-f90db1da-1883-4abe-bc6f-2104e4732529-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Performing cascade delete. {{(pid=87208) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-1dfc64f8-eeda-4b14-82ab-55f003efeb48-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-1dfc64f8-eeda-4b14-82ab-55f003efeb48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-1dfc64f8-eeda-4b14-82ab-55f003efeb48" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-1dfc64f8-eeda-4b14-82ab-55f003efeb48" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Deleting offline snapshot 1dfc64f8-eeda-4b14-82ab-55f003efeb48 of volume f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] snapshot_file for this snap is: volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daf87e2-3bce-4ec6-83ad-674aea87559b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:51 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 Jul 07 10:43:51 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9239abce-2928-4c56-9049-dc0d8f7a7b82 tempest-GroupsV320Test-183657823 None] Group tempest-GroupsV320Test-Group-1973502226: creating Jul 07 10:43:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9239abce-2928-4c56-9049-dc0d8f7a7b82 tempest-GroupsV320Test-183657823 None] Group tempest-GroupsV320Test-Group-1973502226: created successfully Jul 07 10:43:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9239abce-2928-4c56-9049-dc0d8f7a7b82 tempest-GroupsV320Test-183657823 None] Create group completed successfully. Jul 07 10:43:51 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48" returned: 0 in 0.853s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f90db1da-1883-4abe-bc6f-2104e4732529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1b1a7f-4003-4150-901b-dbda309ed29a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:51 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a Jul 07 10:43:51 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:52 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a" returned: 0 in 0.751s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f90db1da-1883-4abe-bc6f-2104e4732529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:52 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 Jul 07 10:43:52 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Created reservations ['2c49a4d4-3a42-4dea-9458-bf0d25571930'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:53 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:43:53 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:53 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:53 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48 Jul 07 10:43:53 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:53 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.661s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:53 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:43:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6a2efa91-6c80-4287-8798-159cbcc238fd tempest-GroupsV320Test-183657823 None] Delete group completed successfully. Jul 07 10:43:54 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.1dfc64f8-eeda-4b14-82ab-55f003efeb48" returned: 0 in 0.690s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-1dfc64f8-eeda-4b14-82ab-55f003efeb48" released by "_delete_snapshot" :: held 3.243s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" released by "delete_snapshot" :: held 3.264s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Created reservations ['a03fb8fb-6e8a-4167-8eff-e19cec113947', 'c55b9f23-412b-47e9-ab91-bccf5f7b7706', 'd9406f71-59e9-4248-b96c-e879c00a61df', '7927bc94-e40c-4361-89eb-cc52642c6dc6'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Delete snapshot completed successfully. Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-1dfc64f8-eeda-4b14-82ab-55f003efeb48-delete_snapshot" released by "delete_snapshot" :: held 3.427s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-adb9619c-41bd-476e-921a-7f8b79e6381a-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-adb9619c-41bd-476e-921a-7f8b79e6381a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-adb9619c-41bd-476e-921a-7f8b79e6381a" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-adb9619c-41bd-476e-921a-7f8b79e6381a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Deleting offline snapshot adb9619c-41bd-476e-921a-7f8b79e6381a of volume f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] snapshot_file for this snap is: volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa284ee-7064-483b-8f8f-79b4a7c30e4e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:54 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a Jul 07 10:43:54 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:55 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f90db1da-1883-4abe-bc6f-2104e4732529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:43:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb17b0-b52f-4604-baa6-41e7a0176141]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:55 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 Jul 07 10:43:55 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:56 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:56 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a Jul 07 10:43:56 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:56 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a" returned: 0 in 0.802s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:56 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a Jul 07 10:43:56 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:57 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529.adb9619c-41bd-476e-921a-7f8b79e6381a" returned: 0 in 0.674s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-adb9619c-41bd-476e-921a-7f8b79e6381a" released by "_delete_snapshot" :: held 3.310s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" released by "delete_snapshot" :: held 3.336s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Created reservations ['8cd8416d-09e7-40fd-9f51-e32351497a62', 'bcb4f368-1d77-467b-bbbd-45001a70e1dd', '39e7f809-c220-4e7b-a651-6307efc0bcf1', '1c61c57c-6d20-49af-965d-268803f1f146'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Delete snapshot completed successfully. Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-adb9619c-41bd-476e-921a-7f8b79e6381a-delete_snapshot" released by "delete_snapshot" :: held 3.516s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Snapshots deleted, issuing volume delete {{(pid=87208) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[38640614-73f2-4361-962c-c5197d09ebc7]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:43:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:57 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 Jul 07 10:43:57 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:58 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529" returned: 0 in 0.784s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:58 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529 Jul 07 10:43:58 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:43:59 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-f90db1da-1883-4abe-bc6f-2104e4732529" returned: 0 in 0.654s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-f90db1da-1883-4abe-bc6f-2104e4732529" released by "delete_volume" :: held 1.510s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Created reservations ['65896e7e-9fba-49d2-8e4b-32a92cb1e583', '304786ad-703d-4d5c-8fc0-cf894080442e', '2b089311-45f2-485e-86c3-71d76afa57e4', 'c839ee21-864c-4596-aa37-66e91b5a3fce'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:43:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:43:59 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:43:59 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Flow 'volume_create_manager' (cfc3c2f3-2dda-4b25-a095-ddbcded8aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce94f7b0-8b1e-4089-aa8f-25080cbee72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce94f7b0-8b1e-4089-aa8f-25080cbee72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1197421330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff79f9aa-af17-4581-bfeb-f85233c4db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d4bd63d90f486e95ea769594ac99a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:00Z,use_quota=True,user_id='3422cc98a0344c1aa291181cd486dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acf2e9f-4f93-4f28-a413-390516c4c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acf2e9f-4f93-4f28-a413-390516c4c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b693b60f-881b-494a-9f59-c36de1c08a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b693b60f-881b-494a-9f59-c36de1c08a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff79f9aa-af17-4581-bfeb-f85233c4db51', 'volume_name': 'volume-ff79f9aa-af17-4581-bfeb-f85233c4db51', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990b3036-211d-4914-a217-ddf2a82881b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990b3036-211d-4914-a217-ddf2a82881b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcf8b22-7f64-4ece-b213-b410ff79281b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:00 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Volume ff79f9aa-af17-4581-bfeb-f85233c4db51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff79f9aa-af17-4581-bfeb-f85233c4db51', 'volume_size': 1} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1197421330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff79f9aa-af17-4581-bfeb-f85233c4db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d4bd63d90f486e95ea769594ac99a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:00Z,use_quota=True,user_id='3422cc98a0344c1aa291181cd486dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Creating volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:44:00 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:00 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 1073741824 Jul 07 10:44:00 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:00 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.908s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Deleted volume successfully. Jul 07 10:44:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6ebffc7-74e3-465e-8e1d-860b946fd3bb tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-f90db1da-1883-4abe-bc6f-2104e4732529-delete_volume" released by "delete_volume" :: held 9.647s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:44:01 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Flow 'volume_create_manager' (d97e2841-d474-4d3a-9ab7-59fcc202a61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8045ec8-0b35-4a8c-b580-f5a1cbbb30a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 1073741824" returned: 0 in 0.928s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8045ec8-0b35-4a8c-b580-f5a1cbbb30a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1495297168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aad32f3-8273-46f4-bff7-662667188c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8689f3239384dd281f3c0f9f4f530a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:01Z,use_quota=True,user_id='3d0cef77c3034202b346e43b95531004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26ebf0e-30ad-425d-9963-c127cf50848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26ebf0e-30ad-425d-9963-c127cf50848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89157b7-188f-4e9b-8a1a-f1eaf0b8430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89157b7-188f-4e9b-8a1a-f1eaf0b8430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aad32f3-8273-46f4-bff7-662667188c28', 'volume_name': 'volume-6aad32f3-8273-46f4-bff7-662667188c28', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a07eb4-d839-4496-9843-fd28593be4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a07eb4-d839-4496-9843-fd28593be4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff6691b-edd0-409d-a9e2-b0df6ab6faa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:01 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Volume 6aad32f3-8273-46f4-bff7-662667188c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aad32f3-8273-46f4-bff7-662667188c28', 'volume_size': 1} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:01 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 Jul 07 10:44:01 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:01 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51" returned: 0 in 0.649s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1495297168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aad32f3-8273-46f4-bff7-662667188c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8689f3239384dd281f3c0f9f4f530a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:01Z,use_quota=True,user_id='3d0cef77c3034202b346e43b95531004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Creating volume 6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:44:01 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:01 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 1073741824 Jul 07 10:44:01 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcf8b22-7f64-4ece-b213-b410ff79281b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff79f9aa-af17-4581-bfeb-f85233c4db51', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d2c43a-61ee-457a-87d0-57824f556554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:01 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Volume volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 (ff79f9aa-af17-4581-bfeb-f85233c4db51): created successfully Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d2c43a-61ee-457a-87d0-57824f556554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Flow 'volume_create_manager' (cfc3c2f3-2dda-4b25-a095-ddbcded8aca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2a2da052-477c-48da-bcf1-b0a925c5a44d tempest-SnapshotsActionsTest-448984631 None] Created volume successfully. Jul 07 10:44:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:02 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 1073741824" returned: 0 in 0.823s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:02 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 Jul 07 10:44:02 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:03 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28" returned: 0 in 0.646s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.070s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff6691b-edd0-409d-a9e2-b0df6ab6faa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aad32f3-8273-46f4-bff7-662667188c28', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a837ee-3ab0-40b7-a96f-cfb11918d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Creating offline snapshot d314fc98-f430-4f22-81e5-eab0da6e2ac6 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:44:03 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Volume volume-6aad32f3-8273-46f4-bff7-662667188c28 (6aad32f3-8273-46f4-bff7-662667188c28): created successfully Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a837ee-3ab0-40b7-a96f-cfb11918d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Flow 'volume_create_manager' (d97e2841-d474-4d3a-9ab7-59fcc202a61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d3f02-a9aa-4702-9fbf-1d30759d3d08]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5421ecf9-7c3f-4e29-9952-178f58367c7a tempest-VolumesDeleteCascade-503006598 None] Created volume successfully. Jul 07 10:44:03 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 Jul 07 10:44:03 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:04 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51" returned: 0 in 0.741s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:04 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 1G Jul 07 10:44:04 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:04 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 1G" returned: 0 in 0.804s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:04 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:04 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:05 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.668s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:05 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 is being set with open permissions: ugo+rw Jul 07 10:44:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:05 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:05 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:06 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.640s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:06 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.info Jul 07 10:44:06 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:06 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.info" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:06 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.info is being set with open permissions: ugo+rw Jul 07 10:44:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:07 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.info Jul 07 10:44:07 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:07 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.info" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.292s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.287s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Creating offline snapshot d79801e2-00c2-4fd0-b5af-38140626376d of volume 6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:44:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-606b6d1a-09d7-4f77-b040-c7d2e74267ac tempest-SnapshotsActionsTest-448984631 None] Create snapshot completed successfully Jul 07 10:44:07 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07a970-c95f-49e9-b0b6-c2189397722a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:07 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 Jul 07 10:44:07 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:08 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28" returned: 0 in 0.767s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:08 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d 1G Jul 07 10:44:08 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:09 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d 1G" returned: 0 in 0.893s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aad32f3-8273-46f4-bff7-662667188c28 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:09 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aad32f3-8273-46f4-bff7-662667188c28 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d Jul 07 10:44:09 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:10 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aad32f3-8273-46f4-bff7-662667188c28 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d" returned: 0 in 0.730s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:10 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d is being set with open permissions: ugo+rw Jul 07 10:44:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:10 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d Jul 07 10:44:10 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:10 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d" returned: 0 in 0.698s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:10 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.info Jul 07 10:44:10 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:11 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.info" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:11 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.info is being set with open permissions: ugo+rw Jul 07 10:44:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:11 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.info Jul 07 10:44:11 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:12 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.info" returned: 0 in 0.665s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.541s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.137s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Creating offline snapshot 9f947213-51ef-4444-b7bb-70410b8d5442 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:44:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d189a7d3-6b5d-460b-943f-ab067d8e64b3 tempest-VolumesDeleteCascade-503006598 None] Create snapshot completed successfully Jul 07 10:44:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec57e7-6b2b-4f0f-9bc8-5919cf9f13fc]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:12 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:12 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-5f7bff9e-a2df-4256-95b6-910500528600 req-3d314f18-4968-4504-8ba1-3cb5cdc0a885 tempest-TestMinimumBasicScenario-151003491 None] Terminate volume connection completed successfully. Jul 07 10:44:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-5f7bff9e-a2df-4256-95b6-910500528600 req-3d314f18-4968-4504-8ba1-3cb5cdc0a885 tempest-TestMinimumBasicScenario-151003491 None] Deleting attachment ed507950-c626-48d7-8b05-1a197fe7d6df. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:44:13 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.850s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:13 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 1G Jul 07 10:44:13 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Flow 'volume_create_manager' (06bc826a-609f-4655-aa65-293d46e65c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cf9bf8-dd24-470e-8aa5-eae0400814d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cf9bf8-dd24-470e-8aa5-eae0400814d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-426650782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80dcad8-f196-46c7-972d-b6bc8a51fa87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8689f3239384dd281f3c0f9f4f530a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d79801e2-00c2-4fd0-b5af-38140626376d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:13Z,use_quota=True,user_id='3d0cef77c3034202b346e43b95531004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcec7794-c206-4c2d-8c63-937a1db28fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcec7794-c206-4c2d-8c63-937a1db28fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea0cdba-33b2-4b87-8ff8-2eba98eb78aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea0cdba-33b2-4b87-8ff8-2eba98eb78aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e80dcad8-f196-46c7-972d-b6bc8a51fa87', 'volume_name': 'volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87', 'volume_size': 1, 'snapshot_id': 'd79801e2-00c2-4fd0-b5af-38140626376d'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c249ba7d-4a3c-43c5-8cbd-32de04b54c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c249ba7d-4a3c-43c5-8cbd-32de04b54c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dd50e9-d631-4b23-a437-84b8761c78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:13 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Volume e80dcad8-f196-46c7-972d-b6bc8a51fa87: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87', 'volume_size': 1, 'snapshot_id': 'd79801e2-00c2-4fd0-b5af-38140626376d'} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:13 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 1G" returned: 0 in 0.815s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:13 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 Jul 07 10:44:13 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Acquiring lock "cinder-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Lock "cinder-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Acquiring lock "cinder-quobyte-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Lock "cinder-quobyte-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd45f6f8-bed2-4aee-aa82-720f52e45cac]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:14 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442" returned: 0 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:14 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 is being set with open permissions: ugo+rw Jul 07 10:44:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:14 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 Jul 07 10:44:14 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:14 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 Jul 07 10:44:14 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:15 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442" returned: 0 in 0.665s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:15 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-d79801e2-00c2-4fd0-b5af-38140626376d-e80dcad8-f196-46c7-972d-b6bc8a51fa87" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8" returned: 0 in 0.769s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:15 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8 Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-d79801e2-00c2-4fd0-b5af-38140626376d-e80dcad8-f196-46c7-972d-b6bc8a51fa87" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Creating volume e80dcad8-f196-46c7-972d-b6bc8a51fa87 from snapshot d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:15 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-e80dcad8-f196-46c7-972d-b6bc8a51fa87" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:15 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3610e1cd-078e-4fe8-9dc9-9a2667c4ea8c tempest-SnapshotsActionsTest-448984631 None] Create snapshot completed successfully Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-e80dcad8-f196-46c7-972d-b6bc8a51fa87" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] snapshot: d79801e2-00c2-4fd0-b5af-38140626376d, volume: e80dcad8-f196-46c7-972d-b6bc8a51fa87, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c8ca78-2701-45c8-8c87-029ae7747a75]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:15 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d Jul 07 10:44:15 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:16 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8" returned: 0 in 0.665s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Lock "cinder-quobyte-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8" released by "delete_volume" :: held 1.479s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Created reservations ['aed4e17d-4255-4dc0-b91b-a3829d0408ee', '0b467be5-91a1-4f2a-b33c-376c3b95fae8', '35db0b34-d16d-4811-a60f-edcbd099009f', 'a9e6fe32-7bb5-4915-9972-9ee001042b7c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:16 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:44:16 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:16 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d" returned: 0 in 0.803s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aad32f3-8273-46f4-bff7-662667188c28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e698498-f0f2-44e1-b070-e1f259789bdb]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-9f947213-51ef-4444-b7bb-70410b8d5442-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:16 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 Jul 07 10:44:16 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-9f947213-51ef-4444-b7bb-70410b8d5442-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-9f947213-51ef-4444-b7bb-70410b8d5442" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-9f947213-51ef-4444-b7bb-70410b8d5442" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Deleting offline snapshot 9f947213-51ef-4444-b7bb-70410b8d5442 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] snapshot_file for this snap is: volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d439f5ec-5fa3-46f0-9880-ac042d5bb8bc]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:16 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 Jul 07 10:44:16 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:16 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.691s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Deleted volume successfully. Jul 07 10:44:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f10970d3-45f2-48cb-8f71-e9027e3e82f9 tempest-TestMinimumBasicScenario-151003491 None] Lock "cinder-abdfc64e-b8f5-4fed-b1e4-3462439f6ae8-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:17 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28" returned: 0 in 0.866s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:17 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:44:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:17 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 Jul 07 10:44:17 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:17 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442" returned: 0 in 0.848s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:17 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[829611c4-a3c5-4871-b555-480c9a881717]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:17 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:17 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:18 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.898s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:18 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 Jul 07 10:44:18 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:20 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442" returned: 0 in 2.177s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:20 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442 Jul 07 10:44:20 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:22 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.9f947213-51ef-4444-b7bb-70410b8d5442" returned: 0 in 1.590s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-9f947213-51ef-4444-b7bb-70410b8d5442" released by "_delete_snapshot" :: held 5.638s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" released by "delete_snapshot" :: held 5.672s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Created reservations ['00c13c65-89ca-4f88-9494-94ca1841504b', '716cb7ee-c188-410e-8348-c237df797a91', '900b3343-3b61-4e8b-97b8-e73c5c5da819', 'ba1d2823-7e61-4de5-a447-252439cb8a14'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:22 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Delete snapshot completed successfully. Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4c37955b-20cf-491d-8548-383cdc61f270 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-9f947213-51ef-4444-b7bb-70410b8d5442-delete_snapshot" released by "delete_snapshot" :: held 5.983s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:22 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87" returned: 0 in 5.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97f140a-be32-487d-8750-b2b6d2506be2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:23 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 Jul 07 10:44:23 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:23 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:44:23 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:23 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28" returned: 0 in 0.957s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:44:23 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Converted 1024.00 MB image at 180.26 MB/s Jul 07 10:44:23 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 is being set with open permissions: ugo+rw Jul 07 10:44:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:23 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 Jul 07 10:44:23 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:24 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.711s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:44:24 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87" returned: 0 in 0.659s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-e80dcad8-f196-46c7-972d-b6bc8a51fa87" released by "_copy_volume_from_snapshot" :: held 9.074s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-d79801e2-00c2-4fd0-b5af-38140626376d-e80dcad8-f196-46c7-972d-b6bc8a51fa87" released by "_create_volume_from_snapshot" :: held 9.112s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.152s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.206s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Creating offline snapshot e13228ea-55b7-4de8-8efe-5c054f6b689f of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dd50e9-d631-4b23-a437-84b8761c78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87', 'volume_size': 1, 'snapshot_id': 'd79801e2-00c2-4fd0-b5af-38140626376d'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db15a71-3fdd-4dd5-b42e-b5f27699740e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b8e17-af83-4c5b-a194-99c313d2cd70]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Volume volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 (e80dcad8-f196-46c7-972d-b6bc8a51fa87): created successfully Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db15a71-3fdd-4dd5-b42e-b5f27699740e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Flow 'volume_create_manager' (06bc826a-609f-4655-aa65-293d46e65c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-29b16312-0284-401d-92a6-1373b117f2ae tempest-VolumesDeleteCascade-503006598 None] Created volume successfully. Jul 07 10:44:24 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:24 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-6aad32f3-8273-46f4-bff7-662667188c28-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-6aad32f3-8273-46f4-bff7-662667188c28-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Performing cascade delete. {{(pid=87208) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-d79801e2-00c2-4fd0-b5af-38140626376d-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-d79801e2-00c2-4fd0-b5af-38140626376d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:25 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.843s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-6aad32f3-8273-46f4-bff7-662667188c28" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:25 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f 1G Jul 07 10:44:25 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-6aad32f3-8273-46f4-bff7-662667188c28" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-d79801e2-00c2-4fd0-b5af-38140626376d" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-d79801e2-00c2-4fd0-b5af-38140626376d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Deleting offline snapshot d79801e2-00c2-4fd0-b5af-38140626376d of volume 6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] snapshot_file for this snap is: volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6094ded-e647-4c6c-8fea-07b1168a99d7]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:25 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d Jul 07 10:44:25 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:26 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f 1G" returned: 0 in 0.873s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:26 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aad32f3-8273-46f4-bff7-662667188c28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:26 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f Jul 07 10:44:26 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4da177-94e2-4776-9a1f-785edd80b313]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:26 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 Jul 07 10:44:26 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:27 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f" returned: 0 in 0.718s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:27 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f is being set with open permissions: ugo+rw Jul 07 10:44:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:27 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f Jul 07 10:44:27 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:27 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:27 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d Jul 07 10:44:27 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:27 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f" returned: 0 in 0.700s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.255s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-29cb3089-4b97-4033-8767-1a6a0512db95 tempest-SnapshotsActionsTest-448984631 None] Create snapshot completed successfully Jul 07 10:44:28 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d" returned: 0 in 0.807s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:28 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d Jul 07 10:44:28 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-e13228ea-55b7-4de8-8efe-5c054f6b689f-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-e13228ea-55b7-4de8-8efe-5c054f6b689f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-e13228ea-55b7-4de8-8efe-5c054f6b689f" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-e13228ea-55b7-4de8-8efe-5c054f6b689f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Deleting offline snapshot e13228ea-55b7-4de8-8efe-5c054f6b689f of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] snapshot_file for this snap is: volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5a3b3-f1d9-4a05-966f-d166d6aef16d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:28 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28.d79801e2-00c2-4fd0-b5af-38140626376d" returned: 0 in 0.808s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-d79801e2-00c2-4fd0-b5af-38140626376d" released by "_delete_snapshot" :: held 3.343s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-6aad32f3-8273-46f4-bff7-662667188c28" released by "delete_snapshot" :: held 3.370s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:28 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f Jul 07 10:44:28 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:28 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Created reservations ['6d9e3d76-cd5e-4429-8d0d-8c53341e1df6', '4737c0bc-b7af-44af-b55c-3c83d106dccd', '35f65b43-6437-45b5-af18-44081e51ff29', '1f24712c-345a-46fa-bf8b-76eb42fc49e1'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Delete snapshot completed successfully. Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-d79801e2-00c2-4fd0-b5af-38140626376d-delete_snapshot" released by "delete_snapshot" :: held 3.568s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Snapshots deleted, issuing volume delete {{(pid=87208) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-6aad32f3-8273-46f4-bff7-662667188c28" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-6aad32f3-8273-46f4-bff7-662667188c28" acquired by "delete_volume" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f52e482-c446-42b4-8990-89608818b987]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:29 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 Jul 07 10:44:29 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:29 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f" returned: 0 in 0.833s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4e7d6-7073-44a2-abe8-df090dafc3e3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:29 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:29 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:29 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28" returned: 0 in 0.800s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:29 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28 Jul 07 10:44:29 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:30 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.832s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:30 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f Jul 07 10:44:30 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:30 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6aad32f3-8273-46f4-bff7-662667188c28" returned: 0 in 0.697s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-6aad32f3-8273-46f4-bff7-662667188c28" released by "delete_volume" :: held 1.573s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Created reservations ['11409f06-22e4-4d83-9bef-a00b6620bad2', 'd7d2ed0e-2670-4cea-a3ee-82097b26dffd', '4295c4d7-05ac-4b14-b079-39ec01b0de9c', '2ec445a3-ce69-41b6-b541-579e5b9368da'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:30 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:44:30 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-e80dcad8-f196-46c7-972d-b6bc8a51fa87-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-e80dcad8-f196-46c7-972d-b6bc8a51fa87-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "cinder-quobyte-e80dcad8-f196-46c7-972d-b6bc8a51fa87" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-e80dcad8-f196-46c7-972d-b6bc8a51fa87" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d0961e-b6c2-4d30-8dfe-4262c35943d8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:31 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 Jul 07 10:44:31 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:31 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f" returned: 0 in 0.940s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:31 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f Jul 07 10:44:31 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:31 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.775s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Deleted volume successfully. Jul 07 10:44:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7fed1383-7b05-4ee7-b409-dddd3e996284 tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-6aad32f3-8273-46f4-bff7-662667188c28-delete_volume" released by "delete_volume" :: held 6.269s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:32 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87" returned: 0 in 0.890s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:32 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87 Jul 07 10:44:32 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:32 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.e13228ea-55b7-4de8-8efe-5c054f6b689f" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-e13228ea-55b7-4de8-8efe-5c054f6b689f" released by "_delete_snapshot" :: held 3.620s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" released by "delete_snapshot" :: held 3.649s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Created reservations ['e15d9337-1252-4e77-802a-9a0a72763fb1', '40554f84-40b2-4629-8806-4689e32e341f', 'c0e65c96-291a-41f4-927d-73a48de1eb01', 'edf0adfb-7e3d-4fc2-b87d-69a52e477da5'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:32 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Delete snapshot completed successfully. Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e5d9551c-70bc-4d0e-a664-5bde6524824c tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-e13228ea-55b7-4de8-8efe-5c054f6b689f-delete_snapshot" released by "delete_snapshot" :: held 3.851s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:32 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e80dcad8-f196-46c7-972d-b6bc8a51fa87" returned: 0 in 0.853s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-quobyte-e80dcad8-f196-46c7-972d-b6bc8a51fa87" released by "delete_volume" :: held 1.801s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:32 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Created reservations ['bde55e82-c98d-41a9-827f-45743163ef6a', 'ab7107ed-b57b-4c6d-ae5e-4334e6b07ed9', '0d6e5a03-57ab-472e-9492-ee63df79a38e', '6d53a08e-16aa-48eb-9887-685da7caecaa'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:33 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:44:33 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Creating offline snapshot b64e7463-72d1-44a5-9d52-67e6e3d22443 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c9519d-7214-454b-8001-6e862d340a5c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:33 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:33 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:33 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.832s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Deleted volume successfully. Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=98,cinder:UPDATE=106,cinder:INSERT=28,cinder:DELETE=13 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:44:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ee23ae2b-9333-428f-8d9d-03f2dddd899c tempest-VolumesDeleteCascade-503006598 None] Lock "cinder-e80dcad8-f196-46c7-972d-b6bc8a51fa87-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:34 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.907s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:34 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 1G Jul 07 10:44:34 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:35 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 1G" returned: 0 in 0.918s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:35 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 Jul 07 10:44:35 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:36 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443" returned: 0 in 0.732s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:36 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 is being set with open permissions: ugo+rw Jul 07 10:44:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:36 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 Jul 07 10:44:36 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:36 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:36 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=97,cinder:SELECT=104,cinder:INSERT=25,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:44:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.397s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c3f073bd-3bff-43f7-b449-34be3f15901e tempest-SnapshotsActionsTest-448984631 None] Create snapshot completed successfully Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-b64e7463-72d1-44a5-9d52-67e6e3d22443-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-b64e7463-72d1-44a5-9d52-67e6e3d22443-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-b64e7463-72d1-44a5-9d52-67e6e3d22443" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-b64e7463-72d1-44a5-9d52-67e6e3d22443" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Deleting offline snapshot b64e7463-72d1-44a5-9d52-67e6e3d22443 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] snapshot_file for this snap is: volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2c72a9-a0a0-4781-b6ab-669e0823d6e8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:37 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 Jul 07 10:44:37 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Flow 'volume_create_manager' (1ba5ed8b-d4da-47ae-8205-44c1caef052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4bbf14-7419-4734-8294-e9ef68744c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4bbf14-7419-4734-8294-e9ef68744c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1750511537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1164a6-e2e7-4728-a492-31b96f94d651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5641f7549dfc427aa6b6f55d1212e772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:38Z,use_quota=True,user_id='2ad589ac67d643ad9f6368156439911a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d4b656-472a-4eeb-81d0-eed261033dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d4b656-472a-4eeb-81d0-eed261033dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e979c360-1648-47eb-8529-4b0be1906259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e979c360-1648-47eb-8529-4b0be1906259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1164a6-e2e7-4728-a492-31b96f94d651', 'volume_name': 'volume-6f1164a6-e2e7-4728-a492-31b96f94d651', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0b9df6-a092-4d14-b75a-66f2e9d45c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0b9df6-a092-4d14-b75a-66f2e9d45c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fee21d-73d7-4924-9af1-34463d73a609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Volume 6f1164a6-e2e7-4728-a492-31b96f94d651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1164a6-e2e7-4728-a492-31b96f94d651', 'volume_size': 1} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1750511537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1164a6-e2e7-4728-a492-31b96f94d651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5641f7549dfc427aa6b6f55d1212e772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:38Z,use_quota=True,user_id='2ad589ac67d643ad9f6368156439911a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Creating volume 6f1164a6-e2e7-4728-a492-31b96f94d651 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:44:38 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:38 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 1073741824 Jul 07 10:44:38 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:38 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443" returned: 0 in 0.867s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[38173e00-cec8-4793-8674-35d33b9ca41a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:38 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:38 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:39 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 1073741824" returned: 0 in 0.888s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:39 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 Jul 07 10:44:39 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:39 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.810s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:39 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 Jul 07 10:44:39 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:40 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651" returned: 0 in 0.690s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fee21d-73d7-4924-9af1-34463d73a609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1164a6-e2e7-4728-a492-31b96f94d651', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c613533-bff7-49cf-bce8-904aec1c7e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Volume volume-6f1164a6-e2e7-4728-a492-31b96f94d651 (6f1164a6-e2e7-4728-a492-31b96f94d651): created successfully Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c613533-bff7-49cf-bce8-904aec1c7e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Flow 'volume_create_manager' (1ba5ed8b-d4da-47ae-8205-44c1caef052f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4ebc8b95-c973-497f-9883-0cd381607171 tempest-VolumesTransfersV355Test-2144962174 None] Created volume successfully. Jul 07 10:44:40 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443" returned: 0 in 0.843s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:40 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443 Jul 07 10:44:40 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:41 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.b64e7463-72d1-44a5-9d52-67e6e3d22443" returned: 0 in 0.842s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-b64e7463-72d1-44a5-9d52-67e6e3d22443" released by "_delete_snapshot" :: held 3.482s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" released by "delete_snapshot" :: held 3.508s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:41 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Created reservations ['5a36f9c9-fc43-46a4-89b5-05e5bbdc629f', '632f7183-5331-4930-b0a6-417a6623840b', 'a73793e0-f1e6-4758-ae84-39efaa9c4002', '7e7f35a6-3600-4818-9596-cff63be0024b'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f887cd30-3e78-4341-8e59-dd40ec3efd89 tempest-VolumesTransfersV355Test-1601695340 None] Transfer volume completed successfully. Jul 07 10:44:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Delete snapshot completed successfully. Jul 07 10:44:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f0b7be1-0ca9-41a5-bfec-22c33bd31bbf tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-b64e7463-72d1-44a5-9d52-67e6e3d22443-delete_snapshot" released by "delete_snapshot" :: held 3.686s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Creating offline snapshot 5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Acquiring lock "cinder-6f1164a6-e2e7-4728-a492-31b96f94d651-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8a6b07-3dd9-47e5-9bb8-b9b2ac640a41]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-6f1164a6-e2e7-4728-a492-31b96f94d651-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Acquiring lock "cinder-quobyte-6f1164a6-e2e7-4728-a492-31b96f94d651" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-quobyte-6f1164a6-e2e7-4728-a492-31b96f94d651" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8fe07b-7e6f-4ef0-ada7-a9f10884135a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:42 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:42 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:42 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 Jul 07 10:44:42 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:43 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.811s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:43 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 1G Jul 07 10:44:43 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:43 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651" returned: 0 in 0.831s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:43 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651 Jul 07 10:44:43 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:43 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6f1164a6-e2e7-4728-a492-31b96f94d651" returned: 0 in 0.672s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-quobyte-6f1164a6-e2e7-4728-a492-31b96f94d651" released by "delete_volume" :: held 1.561s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Created reservations ['af0392c3-dd43-42f9-b072-735349af0316', 'e7eb6f78-ccd2-4982-8ba7-b343203a971c', '733f4bba-2760-4910-b920-e2ccd8ff5644', 'd2f85fee-948b-4988-a998-5cc84a54fa30'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:44 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:44:44 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:44 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 1G" returned: 0 in 1.036s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:44 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 Jul 07 10:44:44 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:44 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:44 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Deleted volume successfully. Jul 07 10:44:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7b9f5694-ce12-4973-8ef4-fe89599583f6 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-6f1164a6-e2e7-4728-a492-31b96f94d651-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:45 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" returned: 0 in 0.885s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:45 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 is being set with open permissions: ugo+rw Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:45 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 Jul 07 10:44:45 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Flow 'volume_create_manager' (402ccccb-3c29-419c-a413-062c2ce36f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf6d94a-7a75-4448-b90e-5dae93b8924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf6d94a-7a75-4448-b90e-5dae93b8924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1740611875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628e1a28-3969-48bd-90b9-fdbbca04cc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5641f7549dfc427aa6b6f55d1212e772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:45Z,use_quota=True,user_id='2ad589ac67d643ad9f6368156439911a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0cf3dd-67b5-43ec-b137-1c63b7fd7159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0cf3dd-67b5-43ec-b137-1c63b7fd7159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e11b8a-cdff-4626-ad14-374062f433fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e11b8a-cdff-4626-ad14-374062f433fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628e1a28-3969-48bd-90b9-fdbbca04cc82', 'volume_name': 'volume-628e1a28-3969-48bd-90b9-fdbbca04cc82', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa14584-be36-471a-876e-c39c5d8b3371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa14584-be36-471a-876e-c39c5d8b3371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e212913-8231-4503-9e7a-082c8dd38653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:45 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Volume 628e1a28-3969-48bd-90b9-fdbbca04cc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628e1a28-3969-48bd-90b9-fdbbca04cc82', 'volume_size': 1} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:45 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" returned: 0 in 0.735s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1740611875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628e1a28-3969-48bd-90b9-fdbbca04cc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5641f7549dfc427aa6b6f55d1212e772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:45Z,use_quota=True,user_id='2ad589ac67d643ad9f6368156439911a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Creating volume 628e1a28-3969-48bd-90b9-fdbbca04cc82 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:44:45 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:44:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:45 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 1073741824 Jul 07 10:44:45 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-95468192-491f-461e-984b-bad216238a84 tempest-SnapshotsActionsTest-448984631 None] Create snapshot completed successfully Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Acquiring lock "cinder-quobyte-5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Deleting offline snapshot 5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] snapshot_file for this snap is: volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd49ff-0f00-4c21-b042-2ad9a64d7112]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:46 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 1073741824" returned: 0 in 1.012s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:46 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 Jul 07 10:44:46 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:46 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 Jul 07 10:44:46 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:47 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" returned: 0 in 0.828s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:47 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82" returned: 0 in 0.724s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3127bd94-1f5e-4cf1-8545-bf19342f0fab]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e212913-8231-4503-9e7a-082c8dd38653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628e1a28-3969-48bd-90b9-fdbbca04cc82', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cfaa62-d084-42d7-8c52-892f3db03a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Volume volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 (628e1a28-3969-48bd-90b9-fdbbca04cc82): created successfully Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cfaa62-d084-42d7-8c52-892f3db03a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Flow 'volume_create_manager' (402ccccb-3c29-419c-a413-062c2ce36f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2f6f2c62-bcd7-4533-91ff-e2162db1b98d tempest-VolumesTransfersV355Test-2144962174 None] Created volume successfully. Jul 07 10:44:47 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:47 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:48 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:48 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 Jul 07 10:44:48 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Acquiring lock "cinder-628e1a28-3969-48bd-90b9-fdbbca04cc82-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-628e1a28-3969-48bd-90b9-fdbbca04cc82-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Acquiring lock "cinder-quobyte-628e1a28-3969-48bd-90b9-fdbbca04cc82" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-quobyte-628e1a28-3969-48bd-90b9-fdbbca04cc82" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ca3c02-a44d-4349-aacf-51e57bc834b4]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:48 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 Jul 07 10:44:48 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:49 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:49 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52 Jul 07 10:44:49 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:49 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82" returned: 0 in 0.803s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:49 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82 Jul 07 10:44:49 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:50 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" returned: 0 in 0.704s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52" released by "_delete_snapshot" :: held 3.339s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" released by "delete_snapshot" :: held 3.371s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Created reservations ['14c40838-5fc8-4de6-8024-ac1bba5bb466', '920487c7-447e-499b-8c91-d91488d6f9eb', '8c895a83-e2e5-40a3-9573-95e7dc4856a9', 'ad9a1f01-067d-4d50-b7b1-880b52cd10a2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Delete snapshot completed successfully. Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-34ba125b-a4e0-48e1-b45d-b80f638ca2c8 tempest-SnapshotsActionsTest-2109843931 None] Lock "cinder-5862ff2a-a8c4-442f-8eb1-9d4c7ad74e52-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:50 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-628e1a28-3969-48bd-90b9-fdbbca04cc82" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-quobyte-628e1a28-3969-48bd-90b9-fdbbca04cc82" released by "delete_volume" :: held 1.612s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Created reservations ['938f1dbc-75e2-475f-8537-b2cad118856c', 'a29bff43-83ca-40eb-a2e6-cb6b887635dc', '0de1976a-5a38-4c2b-a5ab-a620b89089cc', '0ac6bc6b-30ef-4642-9275-0ff73f95708c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:50 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:44:50 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:51 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.809s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Deleted volume successfully. Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efd46f6a-0946-4ced-b844-7250d6252d26 tempest-VolumesTransfersV355Test-1925121766 None] Lock "cinder-628e1a28-3969-48bd-90b9-fdbbca04cc82-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "cinder-d314fc98-f430-4f22-81e5-eab0da6e2ac6-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-d314fc98-f430-4f22-81e5-eab0da6e2ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "cinder-quobyte-d314fc98-f430-4f22-81e5-eab0da6e2ac6" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-quobyte-d314fc98-f430-4f22-81e5-eab0da6e2ac6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Deleting offline snapshot d314fc98-f430-4f22-81e5-eab0da6e2ac6 of volume ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] snapshot_file for this snap is: volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545547f-ebdc-49ae-ad53-5cd2660a0a62]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:51 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:51 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:52 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.927s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff79f9aa-af17-4581-bfeb-f85233c4db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:44:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7a146-45db-4833-947e-9f664af74921]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:52 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 Jul 07 10:44:52 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:53 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51" returned: 0 in 0.848s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:53 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:53 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:54 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:54 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6 Jul 07 10:44:54 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:55 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51.d314fc98-f430-4f22-81e5-eab0da6e2ac6" returned: 0 in 0.723s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-quobyte-d314fc98-f430-4f22-81e5-eab0da6e2ac6" released by "_delete_snapshot" :: held 3.474s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" released by "delete_snapshot" :: held 3.503s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:55 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Created reservations ['82b2e1ba-34f5-432b-8e70-5b1b268e8148', '532008a7-2378-4d33-a420-371f3d6a1c38', '2e86b0bb-487e-45a5-b35c-b906fe3cb5e7', '99566100-b4f6-44ca-a1b5-72d9960df314'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Delete snapshot completed successfully. Jul 07 10:44:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f3f0361-1b9d-47a1-ad4d-ba78f11f9550 tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-d314fc98-f430-4f22-81e5-eab0da6e2ac6-delete_snapshot" released by "delete_snapshot" :: held 3.677s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "cinder-ff79f9aa-af17-4581-bfeb-f85233c4db51-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-ff79f9aa-af17-4581-bfeb-f85233c4db51-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:44:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:44:56 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f03abea-1725-456e-8666-d39f7aac309d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:44:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:56 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 Jul 07 10:44:56 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:56 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51" returned: 0 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:56 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51 Jul 07 10:44:56 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:57 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ff79f9aa-af17-4581-bfeb-f85233c4db51" returned: 0 in 0.689s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-quobyte-ff79f9aa-af17-4581-bfeb-f85233c4db51" released by "delete_volume" :: held 1.580s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Created reservations ['0befff87-e8da-43b1-ab13-d6f583a10dcb', '422a3349-a4a8-4b64-8a47-96a61fe6dad5', '90c422b3-3de9-4da6-9876-a52f4d8067a8', '39314bb0-899b-41ad-8e75-84d3cdb7b6f8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:57 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:44:57 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:44:58 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 07 10:44:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.772s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:44:58 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:44:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Deleted volume successfully. Jul 07 10:44:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3b853fc8-2d5f-4065-9813-ae86cf4adcec tempest-SnapshotsActionsTest-448984631 None] Lock "cinder-ff79f9aa-af17-4581-bfeb-f85233c4db51-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Flow 'volume_create_manager' (828e1b0e-89c3-4767-86ff-f6880787df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ec5254-fef5-400e-9b3d-3ef77fff2ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ec5254-fef5-400e-9b3d-3ef77fff2ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382273451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933c2a8a-fe1d-477c-88d8-db99ecd09671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e1c4a0a46e4aad9f4fe9d0528c4487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:59Z,use_quota=True,user_id='565942b03fe64897b8960e931e1a8806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2439ae39-b4a5-471f-9999-569eb6dacdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2439ae39-b4a5-471f-9999-569eb6dacdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddeed16-68de-451d-8a24-a682f3671b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddeed16-68de-451d-8a24-a682f3671b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '933c2a8a-fe1d-477c-88d8-db99ecd09671', 'volume_name': 'volume-933c2a8a-fe1d-477c-88d8-db99ecd09671', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042a75c6-7559-4bca-b557-6b919644d760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042a75c6-7559-4bca-b557-6b919644d760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da285ed5-40b2-443d-b1c9-4bde5d6d5c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:44:59 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Volume 933c2a8a-fe1d-477c-88d8-db99ecd09671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-933c2a8a-fe1d-477c-88d8-db99ecd09671', 'volume_size': 1} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382273451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933c2a8a-fe1d-477c-88d8-db99ecd09671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e1c4a0a46e4aad9f4fe9d0528c4487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:44:59Z,use_quota=True,user_id='565942b03fe64897b8960e931e1a8806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Creating volume 933c2a8a-fe1d-477c-88d8-db99ecd09671 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:44:59 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:44:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:44:59 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 1073741824 Jul 07 10:44:59 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:00 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 1073741824" returned: 0 in 1.021s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:00 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 Jul 07 10:45:00 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:01 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671" returned: 0 in 0.724s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da285ed5-40b2-443d-b1c9-4bde5d6d5c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933c2a8a-fe1d-477c-88d8-db99ecd09671', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d93c40-71eb-4d90-b6e5-0e31a6836e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:01 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Volume volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 (933c2a8a-fe1d-477c-88d8-db99ecd09671): created successfully Jul 07 10:45:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d93c40-71eb-4d90-b6e5-0e31a6836e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Flow 'volume_create_manager' (828e1b0e-89c3-4767-86ff-f6880787df93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9fe5a4e3-7523-401d-aab0-e2582eb8a867 tempest-VolumesTransfersV357Test-68825105 None] Created volume successfully. Jul 07 10:45:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b699c8ca-3580-499d-ab0c-b4a3dfc92c88 tempest-VolumesTransfersV357Test-1111560682 None] Transfer volume completed successfully. Jul 07 10:45:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Acquiring lock "cinder-933c2a8a-fe1d-477c-88d8-db99ecd09671-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-933c2a8a-fe1d-477c-88d8-db99ecd09671-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Acquiring lock "cinder-quobyte-933c2a8a-fe1d-477c-88d8-db99ecd09671" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-quobyte-933c2a8a-fe1d-477c-88d8-db99ecd09671" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[474a6e59-aac6-43ec-b129-fae1012a6c0a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:05 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 Jul 07 10:45:05 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:05 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671" returned: 0 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:05 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671 Jul 07 10:45:05 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:06 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-933c2a8a-fe1d-477c-88d8-db99ecd09671" returned: 0 in 0.654s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-quobyte-933c2a8a-fe1d-477c-88d8-db99ecd09671" released by "delete_volume" :: held 1.513s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Created reservations ['b6cd0269-ceb6-47b1-9a93-77a82370cfe3', 'a7f9dbf4-c4b6-4499-b17d-bd2de98d48f1', 'a88a74b8-53d8-4693-84aa-0c14c115f03d', '5d6fe018-75ab-432e-8feb-e486334bd8bd'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:06 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:06 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:07 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.733s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Deleted volume successfully. Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02a6b21a-e8e5-4bb4-b743-6b876fee663c tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-933c2a8a-fe1d-477c-88d8-db99ecd09671-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Flow 'volume_create_manager' (e29ed8c4-ab27-4fe2-8df4-02b05cd200e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d9138b-bb97-438a-8f17-2ef408d38776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d9138b-bb97-438a-8f17-2ef408d38776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-130469860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa954b4-65cf-4fe5-8253-f78241c7717a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e1c4a0a46e4aad9f4fe9d0528c4487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:08Z,use_quota=True,user_id='565942b03fe64897b8960e931e1a8806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84a5e9c-8707-48ad-811b-daef5c9b1e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84a5e9c-8707-48ad-811b-daef5c9b1e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aacc13-df37-4934-b7a3-a2c684f57f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aacc13-df37-4934-b7a3-a2c684f57f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa954b4-65cf-4fe5-8253-f78241c7717a', 'volume_name': 'volume-0aa954b4-65cf-4fe5-8253-f78241c7717a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b0dc4d-1f1b-49ac-bb10-ccabe527d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b0dc4d-1f1b-49ac-bb10-ccabe527d139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b294b487-bdc8-4710-bae6-0e44b218f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:07 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Volume 0aa954b4-65cf-4fe5-8253-f78241c7717a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa954b4-65cf-4fe5-8253-f78241c7717a', 'volume_size': 1} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-130469860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa954b4-65cf-4fe5-8253-f78241c7717a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e1c4a0a46e4aad9f4fe9d0528c4487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:08Z,use_quota=True,user_id='565942b03fe64897b8960e931e1a8806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Creating volume 0aa954b4-65cf-4fe5-8253-f78241c7717a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:45:07 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:45:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:07 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a 1073741824 Jul 07 10:45:07 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:08 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a 1073741824" returned: 0 in 0.997s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:08 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a Jul 07 10:45:08 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:09 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a" returned: 0 in 0.756s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b294b487-bdc8-4710-bae6-0e44b218f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa954b4-65cf-4fe5-8253-f78241c7717a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7820fd-526d-4f9a-97e3-2659a62c1129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:09 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Volume volume-0aa954b4-65cf-4fe5-8253-f78241c7717a (0aa954b4-65cf-4fe5-8253-f78241c7717a): created successfully Jul 07 10:45:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7820fd-526d-4f9a-97e3-2659a62c1129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Flow 'volume_create_manager' (e29ed8c4-ab27-4fe2-8df4-02b05cd200e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f28c27c9-135b-47d4-86c1-99123da41fd6 tempest-VolumesTransfersV357Test-68825105 None] Created volume successfully. Jul 07 10:45:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Acquiring lock "cinder-0aa954b4-65cf-4fe5-8253-f78241c7717a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-0aa954b4-65cf-4fe5-8253-f78241c7717a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Acquiring lock "cinder-quobyte-0aa954b4-65cf-4fe5-8253-f78241c7717a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-quobyte-0aa954b4-65cf-4fe5-8253-f78241c7717a" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:10 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6224c-7ea0-4936-8439-fd93f4025692]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:10 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a Jul 07 10:45:10 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:11 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a" returned: 0 in 0.868s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:11 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a Jul 07 10:45:11 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:12 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0aa954b4-65cf-4fe5-8253-f78241c7717a" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-quobyte-0aa954b4-65cf-4fe5-8253-f78241c7717a" released by "delete_volume" :: held 1.606s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Created reservations ['4604eba6-cfe2-479c-b6c4-fe50a645714d', 'd1ccf15a-db4e-437a-80dc-e7318e1f3e07', '50e1175c-10fa-4515-8576-19fca0926046', '03079d3c-2723-4fa2-afc4-ab85725d0de6'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:12 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:12 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:12 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Deleted volume successfully. Jul 07 10:45:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7aa642d4-9a2b-40cb-a5bc-10a0ff850bd7 tempest-VolumesTransfersV357Test-1896774202 None] Lock "cinder-0aa954b4-65cf-4fe5-8253-f78241c7717a-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Flow 'volume_create_manager' (938d52a3-1702-4f7c-a34f-cea1dcfb5d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae9461b-63df-4dab-bdb6-0c592ab4d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae9461b-63df-4dab-bdb6-0c592ab4d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1804547738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8aa648-99ad-4e5c-b5c8-4bab87249d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8e6d605ff04b09b7efcc34e01691f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:20Z,use_quota=True,user_id='8ae5d739d64640b2818ffa0aca4d4513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e3ce87-6544-4927-874e-dec59f986332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e3ce87-6544-4927-874e-dec59f986332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0f89a9-ff14-4e28-8c32-380d7ebfb878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0f89a9-ff14-4e28-8c32-380d7ebfb878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8aa648-99ad-4e5c-b5c8-4bab87249d2a', 'volume_name': 'volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c6ee5d-5281-4775-8ffd-83f362d39343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c6ee5d-5281-4775-8ffd-83f362d39343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c62d6-9478-43f7-b81e-300d60d06a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:19 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Volume bf8aa648-99ad-4e5c-b5c8-4bab87249d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a', 'volume_size': 1} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1804547738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8aa648-99ad-4e5c-b5c8-4bab87249d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8e6d605ff04b09b7efcc34e01691f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:20Z,use_quota=True,user_id='8ae5d739d64640b2818ffa0aca4d4513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Creating volume bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:45:19 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:45:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:19 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a 1073741824 Jul 07 10:45:19 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:21 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a 1073741824" returned: 0 in 1.188s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:21 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a Jul 07 10:45:21 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:21 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" returned: 0 in 0.795s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c62d6-9478-43f7-b81e-300d60d06a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8cfa53-7c3d-4c09-8c10-aaeb10ea74de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:21 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Volume volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a (bf8aa648-99ad-4e5c-b5c8-4bab87249d2a): created successfully Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8cfa53-7c3d-4c09-8c10-aaeb10ea74de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Flow 'volume_create_manager' (938d52a3-1702-4f7c-a34f-cea1dcfb5d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a7739e3b-16f4-4bde-89bc-32684bd2ab84 tempest-VolumesCloneTest-290084554 None] Created volume successfully. Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Flow 'volume_create_manager' (8fc35875-692d-43b1-a90a-19f9f98ecba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8341c15d-674c-43ea-9d19-5b65c379f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8341c15d-674c-43ea-9d19-5b65c379f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2004994655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109da07e-3cf2-43fb-b9fe-39ccdc138a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138b60778544a64961041f404777f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:23Z,use_quota=True,user_id='0e44224044e64f45a4bc3b6886c70d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db93a5f8-e63d-4441-b234-6aafa0552a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db93a5f8-e63d-4441-b234-6aafa0552a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b25a9b-ecba-4288-a891-24e52f028da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b25a9b-ecba-4288-a891-24e52f028da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109da07e-3cf2-43fb-b9fe-39ccdc138a12', 'volume_name': 'volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802a260d-b1fd-493e-9dc5-4e27665b8aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802a260d-b1fd-493e-9dc5-4e27665b8aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975c3332-62eb-4ccb-93fb-5953de058f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Volume 109da07e-3cf2-43fb-b9fe-39ccdc138a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12', 'volume_size': 1} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2004994655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109da07e-3cf2-43fb-b9fe-39ccdc138a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138b60778544a64961041f404777f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:23Z,use_quota=True,user_id='0e44224044e64f45a4bc3b6886c70d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Creating volume 109da07e-3cf2-43fb-b9fe-39ccdc138a12 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:45:23 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:23 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 1073741824 Jul 07 10:45:23 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Flow 'volume_create_manager' (e4358dc8-48db-4bcb-8a85-e7033a9d692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0e8542-2814-4d5c-9385-7eaa472be026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0e8542-2814-4d5c-9385-7eaa472be026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-435718652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8e31f3-8775-407f-a120-a4471532b613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8e6d605ff04b09b7efcc34e01691f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bf8aa648-99ad-4e5c-b5c8-4bab87249d2a,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:23Z,use_quota=True,user_id='8ae5d739d64640b2818ffa0aca4d4513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3183df-02dc-4684-a59d-20e26d5d83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3183df-02dc-4684-a59d-20e26d5d83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2120386-32bb-4285-843e-478f095dfb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2120386-32bb-4285-843e-478f095dfb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ea8e31f3-8775-407f-a120-a4471532b613', 'volume_name': 'volume-ea8e31f3-8775-407f-a120-a4471532b613', 'volume_size': 2, 'source_volid': 'bf8aa648-99ad-4e5c-b5c8-4bab87249d2a', 'source_volstatus': 'available'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30378d9a-a1a4-4b01-a2d9-bcf746aeee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30378d9a-a1a4-4b01-a2d9-bcf746aeee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe76dc96-a404-4b67-8428-3695181ceaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:23 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Volume ea8e31f3-8775-407f-a120-a4471532b613: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ea8e31f3-8775-407f-a120-a4471532b613', 'volume_size': 2, 'source_volid': 'bf8aa648-99ad-4e5c-b5c8-4bab87249d2a', 'source_volstatus': 'available'} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:23 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:23 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:24 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 1073741824" returned: 0 in 0.980s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:24 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 Jul 07 10:45:24 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:24 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.693s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:45:24 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12" returned: 0 in 0.646s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.197s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:24 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Cloning volume bf8aa648-99ad-4e5c-b5c8-4bab87249d2a to volume ea8e31f3-8775-407f-a120-a4471532b613 Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975c3332-62eb-4ccb-93fb-5953de058f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9524da-affe-494d-a6dd-d80a71dee689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Volume volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 (109da07e-3cf2-43fb-b9fe-39ccdc138a12): created successfully Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9524da-affe-494d-a6dd-d80a71dee689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Flow 'volume_create_manager' (8fc35875-692d-43b1-a90a-19f9f98ecba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Creating offline snapshot 6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 of volume bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:45:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c999c3e6-6fb7-4f21-a4d7-2e3111bc0136 tempest-VolumeQuotasAdminTestJSON-436431277 None] Created volume successfully. Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[68921bbd-e894-4af4-8462-ad3638becb75]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:25 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a Jul 07 10:45:25 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Acquiring lock "cinder-109da07e-3cf2-43fb-b9fe-39ccdc138a12-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "cinder-109da07e-3cf2-43fb-b9fe-39ccdc138a12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Acquiring lock "cinder-quobyte-109da07e-3cf2-43fb-b9fe-39ccdc138a12" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "cinder-quobyte-109da07e-3cf2-43fb-b9fe-39ccdc138a12" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe85fbff-4cc4-4ecd-a381-b25534d10a5a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:25 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 Jul 07 10:45:25 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:25 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" returned: 0 in 0.804s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:25 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 1G Jul 07 10:45:25 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:26 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12" returned: 0 in 0.794s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:26 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12 Jul 07 10:45:26 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:26 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 1G" returned: 0 in 0.849s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:26 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 Jul 07 10:45:26 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:26 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-109da07e-3cf2-43fb-b9fe-39ccdc138a12" returned: 0 in 0.681s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "cinder-quobyte-109da07e-3cf2-43fb-b9fe-39ccdc138a12" released by "delete_volume" :: held 1.519s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:26 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Created reservations ['8681ceea-c15b-4bf8-a29a-4382b6cc37a7', 'e9e88d0b-0080-47ae-a954-2c7d5c758928', '263c04ab-510c-40a0-b48f-bd127b8ce4d9', 'cf105b90-02c7-446c-b6e5-af4127910fad'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:27 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:27 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:27 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" returned: 0 in 0.731s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:27 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 is being set with open permissions: ugo+rw Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:27 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 Jul 07 10:45:27 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:27 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Deleted volume successfully. Jul 07 10:45:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-11c20089-9a81-425b-8cdd-1da3096e1b00 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "cinder-109da07e-3cf2-43fb-b9fe-39ccdc138a12-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:28 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" returned: 0 in 0.689s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:28 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.info Jul 07 10:45:28 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Flow 'volume_create_manager' (4fd0f2f1-0577-48e4-9877-d96266c94eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0fbfff-0f97-4c38-bd31-931e81e0250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0fbfff-0f97-4c38-bd31-931e81e0250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1370435008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b71a60-a43a-48f4-a026-4aa93fe66610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138b60778544a64961041f404777f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:28Z,use_quota=True,user_id='0e44224044e64f45a4bc3b6886c70d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f6aeee-5f22-4d49-8253-8edcc2c29e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f6aeee-5f22-4d49-8253-8edcc2c29e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afde4c0-8bd7-4a33-9d90-94f484b83f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afde4c0-8bd7-4a33-9d90-94f484b83f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b71a60-a43a-48f4-a026-4aa93fe66610', 'volume_name': 'volume-10b71a60-a43a-48f4-a026-4aa93fe66610', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9675917f-57a2-462b-b063-0b6b5e1652d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9675917f-57a2-462b-b063-0b6b5e1652d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904c88b6-e841-4918-9949-5a97c8eb0246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:28 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Volume 10b71a60-a43a-48f4-a026-4aa93fe66610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b71a60-a43a-48f4-a026-4aa93fe66610', 'volume_size': 1} Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:28 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.info" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:28 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.info is being set with open permissions: ugo+rw Jul 07 10:45:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:28 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.info Jul 07 10:45:28 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:29 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.info" returned: 0 in 0.644s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Acquiring lock "cinder-quobyte-ea8e31f3-8775-407f-a120-a4471532b613" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-ea8e31f3-8775-407f-a120-a4471532b613" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] snapshot: 6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4, volume: ea8e31f3-8775-407f-a120-a4471532b613, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c1fe8e-636b-4328-bb59-159c7ab5d314]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:29 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 Jul 07 10:45:29 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:30 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" returned: 0 in 0.770s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:45:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:45:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:45:30 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e375057c-4d1e-4d7e-80d9-eb8e8d85439c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:30 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a Jul 07 10:45:30 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:30 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" returned: 0 in 0.745s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:31 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:45:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:31 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 Jul 07 10:45:31 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:35 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613" returned: 0 in 4.597s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d569b-e87d-4300-9a37-984ac502cce8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:35 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a Jul 07 10:45:35 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:36 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" returned: 0 in 0.917s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:36 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:45:36 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Converted 1024.00 MB image at 222.65 MB/s Jul 07 10:45:36 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 is being set with open permissions: ugo+rw Jul 07 10:45:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:36 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 Jul 07 10:45:36 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:37 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613" returned: 0 in 0.642s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-ea8e31f3-8775-407f-a120-a4471532b613" released by "_copy_volume_from_snapshot" :: held 7.746s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:DELETE=9,cinder:UPDATE=93,cinder:SELECT=58,cinder:INSERT=22 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Acquiring lock "cinder-quobyte-6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Deleting offline snapshot 6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 of volume bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] snapshot_file for this snap is: volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e56154-08ef-483a-9e0a-f4232c3e288f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:37 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 Jul 07 10:45:37 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:37 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" returned: 0 in 0.742s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:45:38 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e919a1-65df-4f1c-b45b-23c892e7b8eb]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:38 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a Jul 07 10:45:38 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:38 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=74,cinder:UPDATE=79,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:45:38 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" returned: 0 in 0.746s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:38 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 Jul 07 10:45:38 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:39 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" returned: 0 in 0.719s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:39 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4 Jul 07 10:45:39 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:40 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a.6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" returned: 0 in 0.642s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-6127cb3b-d3b4-487a-8fe5-68e4f6ec45d4" released by "_delete_snapshot" :: held 2.934s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.308s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.829s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1370435008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b71a60-a43a-48f4-a026-4aa93fe66610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138b60778544a64961041f404777f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:28Z,use_quota=True,user_id='0e44224044e64f45a4bc3b6886c70d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Creating volume 10b71a60-a43a-48f4-a026-4aa93fe66610 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:45:40 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe76dc96-a404-4b67-8428-3695181ceaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8e31f3-8775-407f-a120-a4471532b613', 'volume_size': 2, 'source_volid': 'bf8aa648-99ad-4e5c-b5c8-4bab87249d2a', 'source_volstatus': 'available'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:40 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 1073741824 Jul 07 10:45:40 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a4ff6-d1ff-42d3-b684-8deee4c3c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Volume volume-ea8e31f3-8775-407f-a120-a4471532b613 (ea8e31f3-8775-407f-a120-a4471532b613): created successfully Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a4ff6-d1ff-42d3-b684-8deee4c3c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Flow 'volume_create_manager' (e4358dc8-48db-4bcb-8a85-e7033a9d692d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-51615734-cff1-4d92-b9fd-e86e4187172d tempest-VolumesCloneTest-290084554 None] Created volume successfully. Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Acquiring lock "cinder-ea8e31f3-8775-407f-a120-a4471532b613-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Lock "cinder-ea8e31f3-8775-407f-a120-a4471532b613-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Acquiring lock "cinder-quobyte-ea8e31f3-8775-407f-a120-a4471532b613" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-ea8e31f3-8775-407f-a120-a4471532b613" acquired by "delete_volume" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:41 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 1073741824" returned: 0 in 0.934s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880ec2d-aadb-4926-b061-9d67acefe5fe]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:41 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 Jul 07 10:45:41 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:41 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 Jul 07 10:45:41 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Flow 'volume_create_manager' (e7fe2530-06c6-4334-bdcc-10fdd7a64d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531ae0b-e860-4efd-ac9b-cd16c6bc8091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531ae0b-e860-4efd-ac9b-cd16c6bc8091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1174178615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd7f99b-a948-48e3-b350-7eef83c67a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f813208f6a547418af7ecdee20040c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:41Z,use_quota=True,user_id='da3d9d6b563f4e25aaba4ffda54978eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b577dbf3-7a8e-4ebc-9823-a8ea7dce7bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b577dbf3-7a8e-4ebc-9823-a8ea7dce7bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125d984d-1c64-490e-a2e3-6b801ce2ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125d984d-1c64-490e-a2e3-6b801ce2ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd7f99b-a948-48e3-b350-7eef83c67a11', 'volume_name': 'volume-ffd7f99b-a948-48e3-b350-7eef83c67a11', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29288621-97a5-484b-a63a-a8b0b0372313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29288621-97a5-484b-a63a-a8b0b0372313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b314529f-4cc9-4683-b1bb-ad71941df403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Volume ffd7f99b-a948-48e3-b350-7eef83c67a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd7f99b-a948-48e3-b350-7eef83c67a11', 'volume_size': 1} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:41 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1174178615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd7f99b-a948-48e3-b350-7eef83c67a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f813208f6a547418af7ecdee20040c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:41Z,use_quota=True,user_id='da3d9d6b563f4e25aaba4ffda54978eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Creating volume ffd7f99b-a948-48e3-b350-7eef83c67a11 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:45:41 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904c88b6-e841-4918-9949-5a97c8eb0246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b71a60-a43a-48f4-a026-4aa93fe66610', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:41 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 1073741824 Jul 07 10:45:41 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadb4239-1981-4523-9b4a-7c86d0a7453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:41 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Volume volume-10b71a60-a43a-48f4-a026-4aa93fe66610 (10b71a60-a43a-48f4-a026-4aa93fe66610): created successfully Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadb4239-1981-4523-9b4a-7c86d0a7453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Flow 'volume_create_manager' (4fd0f2f1-0577-48e4-9877-d96266c94eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613" returned: 0 in 0.809s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6f68428c-b84a-492c-b773-a849d947a323 tempest-VolumeQuotasAdminTestJSON-436431277 None] Created volume successfully. Jul 07 10:45:41 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613 Jul 07 10:45:41 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:42 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea8e31f3-8775-407f-a120-a4471532b613" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-ea8e31f3-8775-407f-a120-a4471532b613" released by "delete_volume" :: held 1.558s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Created reservations ['9c286149-d4a9-4d14-ba71-44d3ed0e8942', 'bc3f5682-2311-4c87-b9d6-8757e34c94e1', 'dcdbab6f-15c5-4583-8db3-86df7b724fdd', '7901b4e3-a405-43d5-9b65-ead62b1d6de7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:42 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:42 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:42 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 1073741824" returned: 0 in 0.923s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:42 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 Jul 07 10:45:42 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-58524fc5-1886-4b5a-895a-28cef98cf5b3 tempest-VolumeQuotasAdminTestJSON-722556415 None] Transfer volume completed successfully. Jul 07 10:45:43 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Acquiring lock "cinder-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.665s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Deleted volume successfully. Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Lock "cinder-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:43 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5a66c47d-3e54-4e1f-b0a6-85c97b76bc41 tempest-VolumesCloneTest-290084554 None] Lock "cinder-ea8e31f3-8775-407f-a120-a4471532b613-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Acquiring lock "cinder-quobyte-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11" returned: 0 in 0.788s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4fbe66-1795-42b3-9c56-8c770707b0fc]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b314529f-4cc9-4683-b1bb-ad71941df403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd7f99b-a948-48e3-b350-7eef83c67a11', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2896312e-6b0a-4f81-a4d2-c28e23c8c793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Volume volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 (ffd7f99b-a948-48e3-b350-7eef83c67a11): created successfully Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2896312e-6b0a-4f81-a4d2-c28e23c8c793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Flow 'volume_create_manager' (e7fe2530-06c6-4334-bdcc-10fdd7a64d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8401fea9-f690-4521-9e7c-84089db2efaa tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Created volume successfully. Jul 07 10:45:43 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a Jul 07 10:45:43 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Acquiring lock "cinder-10b71a60-a43a-48f4-a026-4aa93fe66610-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Lock "cinder-10b71a60-a43a-48f4-a026-4aa93fe66610-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Acquiring lock "cinder-quobyte-10b71a60-a43a-48f4-a026-4aa93fe66610" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Lock "cinder-quobyte-10b71a60-a43a-48f4-a026-4aa93fe66610" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:44 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f77a17d-bcbf-4af9-9fd7-1822c40a58b3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:44 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 Jul 07 10:45:44 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:44 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" returned: 0 in 0.784s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:44 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a Jul 07 10:45:44 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:44 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:44 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610 Jul 07 10:45:44 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:45 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Lock "cinder-quobyte-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a" released by "delete_volume" :: held 1.545s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Created reservations ['33e4c8e8-119e-4445-97ea-5687700ebdf5', '85f0a662-508a-44b0-b9d6-088aacf1de60', '6b3039fc-e59e-4549-9241-18f42691eb15', '657f2243-f9f3-445e-992e-3e65df494371'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:45 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:45 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:45 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-10b71a60-a43a-48f4-a026-4aa93fe66610" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Lock "cinder-quobyte-10b71a60-a43a-48f4-a026-4aa93fe66610" released by "delete_volume" :: held 1.504s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Created reservations ['d6b98d6f-c7b0-44b4-8488-176594599f12', '31c0a416-c4cc-4e71-afec-f5a1b048322e', '190a29c8-52ca-4613-af0f-6f1f3de2d68e', '451c46b9-4c1d-4fc3-9000-5b7341d8b7c1'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:45 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:45 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:45 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:45 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Deleted volume successfully. Jul 07 10:45:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2d5f9f71-88b6-4435-87f7-4f6d948e7646 tempest-VolumesCloneTest-290084554 None] Lock "cinder-bf8aa648-99ad-4e5c-b5c8-4bab87249d2a-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:46 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.688s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:46 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:46 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Deleted volume successfully. Jul 07 10:45:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c0149aa4-657c-4e4d-8712-c251b48638ec tempest-VolumeQuotasAdminTestJSON-2141076889 None] Lock "cinder-10b71a60-a43a-48f4-a026-4aa93fe66610-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-76855c27-9319-459c-9a1e-0553521c55eb req-b6d6fa7c-4d96-46cc-af25-0cf55c20b952 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-76855c27-9319-459c-9a1e-0553521c55eb req-b6d6fa7c-4d96-46cc-af25-0cf55c20b952 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:47 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e013f-5941-4646-a172-b11eafc260e2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-76855c27-9319-459c-9a1e-0553521c55eb req-b6d6fa7c-4d96-46cc-af25-0cf55c20b952 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:47 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 Jul 07 10:45:47 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:48 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-76855c27-9319-459c-9a1e-0553521c55eb req-b6d6fa7c-4d96-46cc-af25-0cf55c20b952 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-76855c27-9319-459c-9a1e-0553521c55eb req-b6d6fa7c-4d96-46cc-af25-0cf55c20b952 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.882s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-76855c27-9319-459c-9a1e-0553521c55eb req-b6d6fa7c-4d96-46cc-af25-0cf55c20b952 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-ffd7f99b-a948-48e3-b350-7eef83c67a11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e760f395-5bb1-4f5a-873c-94bcb002d148', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:45:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-76855c27-9319-459c-9a1e-0553521c55eb req-b6d6fa7c-4d96-46cc-af25-0cf55c20b952 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] attachment_update completed successfully. Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Flow 'volume_create_manager' (c22ce498-a2c4-4794-b09e-8d2b079bbd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ccb71b-596b-4af9-8a76-5aad41881096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ccb71b-596b-4af9-8a76-5aad41881096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1437921978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa68f8f2-3edc-4591-ba6b-9600c9101576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993604b026b431c884685ad1a69d2b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:49Z,use_quota=True,user_id='c1c30a871a7f4b87b269268c321bfda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e853c21-a365-4c89-a6a9-738c21081c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e853c21-a365-4c89-a6a9-738c21081c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ef2076-0468-4e57-bfa5-474cd7a0efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:49 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ef2076-0468-4e57-bfa5-474cd7a0efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa68f8f2-3edc-4591-ba6b-9600c9101576', 'volume_name': 'volume-aa68f8f2-3edc-4591-ba6b-9600c9101576', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e9b8e6-5066-4683-adf3-fe6e5907d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e9b8e6-5066-4683-adf3-fe6e5907d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eecc6fc-dd2a-489c-8e84-80a0888cfcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:50 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Volume aa68f8f2-3edc-4591-ba6b-9600c9101576: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa68f8f2-3edc-4591-ba6b-9600c9101576', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Trying to clone aa68f8f2-3edc-4591-ba6b-9600c9101576 from image d50a09c8-834c-44f1-b638-afb2a382f8e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:45:50 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Image download 20.69 MB at 20.69 MB/s Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ddf894-16e7-44cf-a6b4-b9637ba86792]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:50 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD Jul 07 10:45:50 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:51 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:51 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 is fetched for user c1c30a871a7f4b87b269268c321bfda9. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:45:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ea153-2de0-40dd-802e-800872a8b9cc]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:51 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD Jul 07 10:45:51 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:52 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1437921978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa68f8f2-3edc-4591-ba6b-9600c9101576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993604b026b431c884685ad1a69d2b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:49Z,use_quota=True,user_id='c1c30a871a7f4b87b269268c321bfda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Creating volume aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:45:52 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:45:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:52 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 1073741824 Jul 07 10:45:52 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:53 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 1073741824" returned: 0 in 0.867s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:53 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:45:53 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:53 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 0 in 0.695s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Attempting download of d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume aa68f8f2-3edc-4591-ba6b-9600c9101576. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab769df-5971-4fda-a465-12b80ea3c81a]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_2s2yypz9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:45:54 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_2s2yypz9 Jul 07 10:45:54 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Flow 'volume_create_manager' (2a321615-0c14-4d87-a246-d3c1c6d245be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ce977b-92f0-4834-a254-bc37974e2944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ce977b-92f0-4834-a254-bc37974e2944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1349814336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a62dc5f-5a40-433c-88b7-672d4d47948d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbc65c89da6449a8ce7fcd81ef11439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:54Z,use_quota=True,user_id='6e40633d0f8b46d5b84df4dc43857d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43e3c5c7-2bcf-47c1-aad7-f5e512e5389f),volume_type_id=43e3c5c7-2bcf-47c1-aad7-f5e512e5389f)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ef66af-0246-4305-ab01-9cd1c9871ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ef66af-0246-4305-ab01-9cd1c9871ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e418e9-68a4-4271-a097-1cf3da024e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e418e9-68a4-4271-a097-1cf3da024e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a62dc5f-5a40-433c-88b7-672d4d47948d', 'volume_name': 'volume-9a62dc5f-5a40-433c-88b7-672d4d47948d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c6c8c3-18f2-4028-93f8-19276d9490de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c6c8c3-18f2-4028-93f8-19276d9490de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1897b267-a870-40f5-ada2-d11ab84578e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:54 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Volume 9a62dc5f-5a40-433c-88b7-672d4d47948d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a62dc5f-5a40-433c-88b7-672d4d47948d', 'volume_size': 1} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1349814336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a62dc5f-5a40-433c-88b7-672d4d47948d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbc65c89da6449a8ce7fcd81ef11439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:45:54Z,use_quota=True,user_id='6e40633d0f8b46d5b84df4dc43857d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43e3c5c7-2bcf-47c1-aad7-f5e512e5389f),volume_type_id=43e3c5c7-2bcf-47c1-aad7-f5e512e5389f)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Creating volume 9a62dc5f-5a40-433c-88b7-672d4d47948d {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:45:54 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:54 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d 1073741824 Jul 07 10:45:54 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:54 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_2s2yypz9" returned: 0 in 0.804s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_2s2yypz9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:54 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_2s2yypz9 Jul 07 10:45:54 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:55 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d 1073741824" returned: 0 in 0.918s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:55 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d Jul 07 10:45:55 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:55 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_2s2yypz9" returned: 1 in 0.775s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_2s2yypz9' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0efd99-a9b7-4b1b-b338-2b344a94322b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:55 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD Jul 07 10:45:55 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:55 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d" returned: 0 in 0.639s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1897b267-a870-40f5-ada2-d11ab84578e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a62dc5f-5a40-433c-88b7-672d4d47948d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29d3a9c-f5ce-41c5-ad70-28c11132d433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:45:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Volume volume-9a62dc5f-5a40-433c-88b7-672d4d47948d (9a62dc5f-5a40-433c-88b7-672d4d47948d): created successfully Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29d3a9c-f5ce-41c5-ad70-28c11132d433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:45:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Flow 'volume_create_manager' (2a321615-0c14-4d87-a246-d3c1c6d245be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:45:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-86b18298-5653-43db-92d9-bf05bfb53ddf tempest-VolumeTypesAccessTest-1288729589 None] Created volume successfully. Jul 07 10:45:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-e83cf726-4ee1-44e6-8c72-0bd03df2ecc7 req-3d9a1d6a-e8b0-495b-872c-21e599b37839 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Terminate volume connection completed successfully. Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-e83cf726-4ee1-44e6-8c72-0bd03df2ecc7 req-3d9a1d6a-e8b0-495b-872c-21e599b37839 tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Deleting attachment e760f395-5bb1-4f5a-873c-94bcb002d148. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Acquiring lock "cinder-9a62dc5f-5a40-433c-88b7-672d4d47948d-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Lock "cinder-9a62dc5f-5a40-433c-88b7-672d4d47948d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Acquiring lock "cinder-quobyte-9a62dc5f-5a40-433c-88b7-672d4d47948d" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Lock "cinder-quobyte-9a62dc5f-5a40-433c-88b7-672d4d47948d" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db0d8ff-8cf5-45a2-87cb-4e6c979c76e8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:56 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] d50a09c8-834c-44f1-b638-afb2a382f8e6 was qcow2, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:45:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:56 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:45:56 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:56 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d Jul 07 10:45:56 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:57 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d" returned: 0 in 0.849s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:57 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d Jul 07 10:45:57 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:57 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9a62dc5f-5a40-433c-88b7-672d4d47948d" returned: 0 in 0.707s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Lock "cinder-quobyte-9a62dc5f-5a40-433c-88b7-672d4d47948d" released by "delete_volume" :: held 1.600s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:57 devstack cinder-volume[87208]: WARNING cinder.quota [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-396549728 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-396549728, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:45:57 devstack cinder-volume[87208]: WARNING cinder.quota [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-396549728 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-396549728, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:45:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Created reservations ['cf73c962-bd11-4fb7-a833-06c08b973592', 'da06d508-6930-467a-8771-ee623b45f587', '36f815b6-5849-4869-bcbc-13382d524fb1', '66e10c82-cf2a-48ef-9313-77905af12c60'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:58 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:45:58 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:58 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 0 in 1.844s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_3a_4nsvedevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:45:58 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Converted 112.00 MB image at 60.70 MB/s Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:58 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 1G Jul 07 10:45:58 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Acquiring lock "cinder-ffd7f99b-a948-48e3-b350-7eef83c67a11-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "cinder-ffd7f99b-a948-48e3-b350-7eef83c67a11-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Acquiring lock "cinder-quobyte-ffd7f99b-a948-48e3-b350-7eef83c67a11" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "cinder-quobyte-ffd7f99b-a948-48e3-b350-7eef83c67a11" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a343a6-9a43-4684-86df-5f240cf79ba6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:58 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 Jul 07 10:45:58 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:58 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.746s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:45:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Deleted volume successfully. Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c33a9702-3397-4491-bac1-992af7dd73a0 tempest-VolumeTypesAccessTest-1288729589 None] Lock "cinder-9a62dc5f-5a40-433c-88b7-672d4d47948d-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:45:58 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 1G" returned: 0 in 0.784s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:59 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e76feef-da56-4cf4-844f-a8a9444a5e8d]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:45:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:59 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:45:59 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:59 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11" returned: 0 in 0.907s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:59 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11 Jul 07 10:45:59 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:45:59 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Jul 07 10:45:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 0 in 0.817s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:45:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:45:59 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:45:59 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:00 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ffd7f99b-a948-48e3-b350-7eef83c67a11" returned: 0 in 0.682s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "cinder-quobyte-ffd7f99b-a948-48e3-b350-7eef83c67a11" released by "delete_volume" :: held 1.654s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Created reservations ['1ba8985d-4c67-4088-8d87-5a487ef24d33', '9f31e6f4-18d9-4fe7-a736-cbf7006be3ce', 'e709db45-cd6a-4c48-88d5-784cd3c1035c', 'c4714d34-c727-4b69-ba6a-99f80f7a48b9'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:00 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:00 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:00 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 1 in 0.814s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Downloaded image d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume aa68f8f2-3edc-4591-ba6b-9600c9101576 successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 for user c1c30a871a7f4b87b269268c321bfda9 is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Marking volume aa68f8f2-3edc-4591-ba6b-9600c9101576 as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Copying metadata from image d50a09c8-834c-44f1-b638-afb2a382f8e6 to aa68f8f2-3edc-4591-ba6b-9600c9101576. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Creating volume glance metadata for volume aa68f8f2-3edc-4591-ba6b-9600c9101576 backed by image d50a09c8-834c-44f1-b638-afb2a382f8e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eecc6fc-dd2a-489c-8e84-80a0888cfcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa68f8f2-3edc-4591-ba6b-9600c9101576', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9bf166-5ac8-4ba7-8e6e-fe85ecd67e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:00 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Volume volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 (aa68f8f2-3edc-4591-ba6b-9600c9101576): created successfully Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9bf166-5ac8-4ba7-8e6e-fe85ecd67e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Flow 'volume_create_manager' (c22ce498-a2c4-4794-b09e-8d2b079bbd7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-caeeb296-8135-4204-9d5d-84193a85e994 tempest-VolumesExtendTest-1297413732 None] Created volume successfully. Jul 07 10:46:01 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.882s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:01 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Deleted volume successfully. Jul 07 10:46:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b31b4309-99e1-4dbd-b985-2b61601d7a0f tempest-TestServerVolumeAttachScenarioOldVersion-1921774384 None] Lock "cinder-ffd7f99b-a948-48e3-b350-7eef83c67a11-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:01 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc266604-9ab9-42e6-a63e-230bf7619fdf]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:01 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:46:01 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:02 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 0 in 0.838s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:02 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:46:02 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:03 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 1 in 0.953s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:46:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 2G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 2G" returned: 0 in 0.090s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.959s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bc670466-6327-4020-ad27-a4952fc933fa tempest-VolumesExtendTest-1297413732 None] Extend volume completed successfully. Jul 07 10:46:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Acquiring lock "cinder-aa68f8f2-3edc-4591-ba6b-9600c9101576-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Lock "cinder-aa68f8f2-3edc-4591-ba6b-9600c9101576-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Acquiring lock "cinder-quobyte-aa68f8f2-3edc-4591-ba6b-9600c9101576" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-aa68f8f2-3edc-4591-ba6b-9600c9101576" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[26337076-b27e-4c15-a0e1-b9fc189f86c9]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:04 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:46:04 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:04 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 0 in 0.781s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:05 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:46:05 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:05 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 1 in 0.788s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:46:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:05 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576 Jul 07 10:46:05 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:06 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-aa68f8f2-3edc-4591-ba6b-9600c9101576" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-aa68f8f2-3edc-4591-ba6b-9600c9101576" released by "delete_volume" :: held 2.339s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Created reservations ['68929559-c087-4161-b021-1ce2ab612722', '0ef4a8b2-7131-4e3a-a6eb-2990cfc06ac6', 'b5dd66c6-115d-48ac-9ea1-f4d457539997', 'acdbe269-e113-47cb-a885-82fb5b4e707a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:06 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:06 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:07 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Deleted volume successfully. Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e67f241-9a47-4712-bc65-3d6a835051ab tempest-VolumesExtendTest-1297413732 None] Lock "cinder-aa68f8f2-3edc-4591-ba6b-9600c9101576-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Flow 'volume_create_manager' (0ebff40d-bf2b-4a19-a7da-f23f94da3abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bdc6f9-37bf-4df3-a8e8-4986c9a3ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bdc6f9-37bf-4df3-a8e8-4986c9a3ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-104325174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66461bc9-e259-4b3d-9602-86cb1f791e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993604b026b431c884685ad1a69d2b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:08Z,use_quota=True,user_id='c1c30a871a7f4b87b269268c321bfda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ff1d0f-af53-49c1-8b8c-e5919aa844a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ff1d0f-af53-49c1-8b8c-e5919aa844a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee88520-9354-4a56-b219-a9da4c646153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee88520-9354-4a56-b219-a9da4c646153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66461bc9-e259-4b3d-9602-86cb1f791e83', 'volume_name': 'volume-66461bc9-e259-4b3d-9602-86cb1f791e83', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6bcf6c-bbfb-42f4-8381-929f80988bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6bcf6c-bbfb-42f4-8381-929f80988bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db8ae4b-a542-4913-9f16-2f860f46d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:07 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Volume 66461bc9-e259-4b3d-9602-86cb1f791e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66461bc9-e259-4b3d-9602-86cb1f791e83', 'volume_size': 1} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-104325174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66461bc9-e259-4b3d-9602-86cb1f791e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993604b026b431c884685ad1a69d2b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:08Z,use_quota=True,user_id='c1c30a871a7f4b87b269268c321bfda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Creating volume 66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:07 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:07 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 1073741824 Jul 07 10:46:07 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:08 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 1073741824" returned: 0 in 0.959s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:08 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 Jul 07 10:46:08 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:09 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83" returned: 0 in 0.719s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db8ae4b-a542-4913-9f16-2f860f46d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66461bc9-e259-4b3d-9602-86cb1f791e83', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a8c068-f6dd-450e-b6c4-a2076efd63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:09 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Volume volume-66461bc9-e259-4b3d-9602-86cb1f791e83 (66461bc9-e259-4b3d-9602-86cb1f791e83): created successfully Jul 07 10:46:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a8c068-f6dd-450e-b6c4-a2076efd63b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Flow 'volume_create_manager' (0ebff40d-bf2b-4a19-a7da-f23f94da3abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c8ddc946-a73f-4c3c-9ab9-008200bc9eae tempest-VolumesExtendTest-1297413732 None] Created volume successfully. Jul 07 10:46:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Creating offline snapshot a81a04da-43ea-4c23-a155-d37b5adc6d13 of volume 66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:46:10 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaebf4f-ed75-4b34-8509-c2e6c126b84a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:10 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 Jul 07 10:46:10 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:11 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83" returned: 0 in 0.880s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:11 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 1G Jul 07 10:46:11 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Flow 'volume_create_manager' (e0b56934-7414-4184-b12a-c6e849e14f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fc661f-0f44-4a21-901d-54f126a9d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fc661f-0f44-4a21-901d-54f126a9d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1283455932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fac981-eaba-4f1e-bd06-b6dc794725e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94d6eabcd544be89f60b463f2e0c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:12Z,use_quota=True,user_id='b6bf158145fe4219a651abfddeb1a7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fb7e8d-5ebe-46e2-bcea-8d3647aed081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fb7e8d-5ebe-46e2-bcea-8d3647aed081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f5d75c-01be-4c2b-81e6-d4c8ed31f12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f5d75c-01be-4c2b-81e6-d4c8ed31f12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26fac981-eaba-4f1e-bd06-b6dc794725e8', 'volume_name': 'volume-26fac981-eaba-4f1e-bd06-b6dc794725e8', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a885f55e-2156-427a-9279-88558bfe8450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a885f55e-2156-427a-9279-88558bfe8450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac5f41e-f9a1-418e-8651-f513c256f6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Volume 26fac981-eaba-4f1e-bd06-b6dc794725e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26fac981-eaba-4f1e-bd06-b6dc794725e8', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 10:46:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Trying to clone 26fac981-eaba-4f1e-bd06-b6dc794725e8 from image d50a09c8-834c-44f1-b638-afb2a382f8e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:46:12 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 1G" returned: 0 in 0.939s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66461bc9-e259-4b3d-9602-86cb1f791e83 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:12 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66461bc9-e259-4b3d-9602-86cb1f791e83 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 Jul 07 10:46:12 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:12 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:46:12 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Image download 20.69 MB at 20.69 MB/s Jul 07 10:46:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea87cec9-02ee-4ad8-a7c0-81c9ab58ab81]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:12 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD Jul 07 10:46:12 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:12 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66461bc9-e259-4b3d-9602-86cb1f791e83 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13" returned: 0 in 0.911s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:12 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 is being set with open permissions: ugo+rw Jul 07 10:46:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:13 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 Jul 07 10:46:13 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:13 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:13 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 is fetched for user b6bf158145fe4219a651abfddeb1a7ed. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:46:13 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[325b47db-0447-4122-9f2c-608469c6d073]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:13 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD Jul 07 10:46:13 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:13 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:13 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.info Jul 07 10:46:13 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:14 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:14 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.info" returned: 0 in 0.697s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:14 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.info is being set with open permissions: ugo+rw Jul 07 10:46:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:14 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.info Jul 07 10:46:14 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:15 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.info" returned: 0 in 0.660s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.882s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1283455932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fac981-eaba-4f1e-bd06-b6dc794725e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94d6eabcd544be89f60b463f2e0c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:12Z,use_quota=True,user_id='b6bf158145fe4219a651abfddeb1a7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Creating volume 26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:15 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:15 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 1073741824 Jul 07 10:46:15 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:15 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ba36eb5a-ba12-4b75-83fa-238f593d99a5 tempest-VolumesExtendTest-1297413732 None] Create snapshot completed successfully Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:15 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 1073741824" returned: 0 in 0.872s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:16 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 Jul 07 10:46:16 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:16 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8" returned: 0 in 0.682s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.145s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6967695f-e86c-4275-a708-fe9398ce1fd1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Attempting download of d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume 26fac981-eaba-4f1e-bd06-b6dc794725e8. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f3d26b-a546-4305-8712-b04148e4cc58]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_ovsgrnlz {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:16 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 Jul 07 10:46:16 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:16 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_ovsgrnlz Jul 07 10:46:16 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:17 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83" returned: 0 in 0.852s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 2G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:17 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_ovsgrnlz" returned: 0 in 0.850s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_ovsgrnlz {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 2G" returned: 0 in 0.171s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.063s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:17 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_ovsgrnlz Jul 07 10:46:17 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:17 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a262656f-e459-491c-b479-773d74f63124 tempest-VolumesExtendTest-1297413732 None] Extend volume completed successfully. Jul 07 10:46:18 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_ovsgrnlz" returned: 1 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_ovsgrnlz' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:46:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[873db6cb-15ce-4fea-a6a5-787218dfa877]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:18 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD Jul 07 10:46:18 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "cinder-a81a04da-43ea-4c23-a155-d37b5adc6d13-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-a81a04da-43ea-4c23-a155-d37b5adc6d13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "cinder-quobyte-66461bc9-e259-4b3d-9602-86cb1f791e83" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-66461bc9-e259-4b3d-9602-86cb1f791e83" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "cinder-quobyte-a81a04da-43ea-4c23-a155-d37b5adc6d13" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-a81a04da-43ea-4c23-a155-d37b5adc6d13" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Deleting offline snapshot a81a04da-43ea-4c23-a155-d37b5adc6d13 of volume 66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] snapshot_file for this snap is: volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d0112b-8566-48c4-80f9-fc0fc5fe7306]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:19 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:19 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] d50a09c8-834c-44f1-b638-afb2a382f8e6 was qcow2, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:46:19 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:19 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 Jul 07 10:46:19 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:19 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13" returned: 0 in 0.829s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66461bc9-e259-4b3d-9602-86cb1f791e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4737ba4e-0774-4696-9cbb-c842178da40e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:20 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 Jul 07 10:46:20 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:21 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83" returned: 0 in 1.072s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:21 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 Jul 07 10:46:21 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:21 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8" returned: 0 in 2.114s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:21 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_gqj3ju2hdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:46:21 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Converted 112.00 MB image at 52.95 MB/s Jul 07 10:46:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:21 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 1G Jul 07 10:46:21 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:21 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13" returned: 0 in 0.884s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:21 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13 Jul 07 10:46:21 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:22 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 1G" returned: 0 in 0.745s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bdcec4-60f8-40f5-9543-a22fb6ebfad6]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:22 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 Jul 07 10:46:22 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:22 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83.a81a04da-43ea-4c23-a155-d37b5adc6d13" returned: 0 in 0.699s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-a81a04da-43ea-4c23-a155-d37b5adc6d13" released by "_delete_snapshot" :: held 3.604s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-66461bc9-e259-4b3d-9602-86cb1f791e83" released by "delete_snapshot" :: held 3.631s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Created reservations ['a9515f93-50ff-4598-bb91-4ff175b9e704', '2afaccbc-fd0b-4a67-b3cd-a10e8a5827e0', '488b2296-e095-491e-9630-7b0a6eadcb39', 'f8e4956e-0834-4dd1-ba68-5c8db0e5d755'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:22 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Delete snapshot completed successfully. Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9462cd6b-06e0-4e01-8a23-d269915337a4 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-a81a04da-43ea-4c23-a155-d37b5adc6d13-delete_snapshot" released by "delete_snapshot" :: held 3.794s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:22 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8" returned: 0 in 0.807s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:23 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 Jul 07 10:46:23 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "cinder-66461bc9-e259-4b3d-9602-86cb1f791e83-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-66461bc9-e259-4b3d-9602-86cb1f791e83-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "cinder-quobyte-66461bc9-e259-4b3d-9602-86cb1f791e83" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-66461bc9-e259-4b3d-9602-86cb1f791e83" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29b31c-b63f-4dc2-99fa-f13500027d21]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:23 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 Jul 07 10:46:23 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:23 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:23 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:23 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8" returned: 1 in 0.910s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Downloaded image d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume 26fac981-eaba-4f1e-bd06-b6dc794725e8 successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 for user b6bf158145fe4219a651abfddeb1a7ed is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Marking volume 26fac981-eaba-4f1e-bd06-b6dc794725e8 as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Copying metadata from image d50a09c8-834c-44f1-b638-afb2a382f8e6 to 26fac981-eaba-4f1e-bd06-b6dc794725e8. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Creating volume glance metadata for volume 26fac981-eaba-4f1e-bd06-b6dc794725e8 backed by image d50a09c8-834c-44f1-b638-afb2a382f8e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac5f41e-f9a1-418e-8651-f513c256f6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fac981-eaba-4f1e-bd06-b6dc794725e8', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cafaef-b30e-4940-aa6e-e47d38f5f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:23 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Volume volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 (26fac981-eaba-4f1e-bd06-b6dc794725e8): created successfully Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cafaef-b30e-4940-aa6e-e47d38f5f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Flow 'volume_create_manager' (e0b56934-7414-4184-b12a-c6e849e14f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-60c59ec0-bc47-484b-96bc-d044b92e146c tempest-VolumesImageMetadata-632770942 None] Created volume successfully. Jul 07 10:46:24 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83" returned: 0 in 0.811s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:24 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83 Jul 07 10:46:24 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:24 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.749s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Acquiring lock "cinder-26fac981-eaba-4f1e-bd06-b6dc794725e8-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Lock "cinder-26fac981-eaba-4f1e-bd06-b6dc794725e8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Acquiring lock "cinder-quobyte-26fac981-eaba-4f1e-bd06-b6dc794725e8" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Lock "cinder-quobyte-26fac981-eaba-4f1e-bd06-b6dc794725e8" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[937fc6e6-2828-4df8-a823-9dec447f25d7]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:25 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-66461bc9-e259-4b3d-9602-86cb1f791e83" returned: 0 in 0.773s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-quobyte-66461bc9-e259-4b3d-9602-86cb1f791e83" released by "delete_volume" :: held 1.686s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:25 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 Jul 07 10:46:25 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Created reservations ['d363db74-bf8a-44a2-b7af-ace95fb298bc', 'b4dec7e4-6d3a-42d2-8df4-306b1530ac06', '414a261e-a2e8-4161-9f33-209748192d3b', 'bf82049e-8e48-4119-8285-44b17eec0927'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:25 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:25 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:25 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8" returned: 0 in 0.890s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:26 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 Jul 07 10:46:26 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:26 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.886s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:26 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Deleted volume successfully. Jul 07 10:46:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3f8c097b-48c0-43d7-ad5e-1c0c8abbbb22 tempest-VolumesExtendTest-1297413732 None] Lock "cinder-66461bc9-e259-4b3d-9602-86cb1f791e83-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:26 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8" returned: 1 in 0.978s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:46:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:26 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8 Jul 07 10:46:26 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:27 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-26fac981-eaba-4f1e-bd06-b6dc794725e8" returned: 0 in 0.696s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Lock "cinder-quobyte-26fac981-eaba-4f1e-bd06-b6dc794725e8" released by "delete_volume" :: held 2.638s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Created reservations ['49476592-9d3e-49f2-87f8-fb7c89dde76b', '783c0c78-2a68-4f70-8dbb-ddd2e7ea7203', '54e8835f-9d40-4f58-95bb-c56a8b5579b8', '05ae16b3-3dc9-4c70-9315-3a67076cf8c7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:27 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:27 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:28 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.899s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:28 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:28 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Deleted volume successfully. Jul 07 10:46:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-68f00af0-25d1-4e99-9eb1-21f88ac48e6c tempest-VolumesImageMetadata-632770942 None] Lock "cinder-26fac981-eaba-4f1e-bd06-b6dc794725e8-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Flow 'volume_create_manager' (120cb2f8-167d-4abf-8d7e-23b88ebdc84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620b583a-835b-4259-8253-bddd072895c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620b583a-835b-4259-8253-bddd072895c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-523377329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127b3bbe-f03a-4f51-b757-c3a142d90df6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c232878aa45c48d4a1cdb1828c7045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:30Z,use_quota=True,user_id='2642fbdad69141aa96e759629ee2e142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e343487-5ce2-4698-a2ab-0de44022f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e343487-5ce2-4698-a2ab-0de44022f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb6c830-0aa6-477b-b230-4525c88b643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb6c830-0aa6-477b-b230-4525c88b643f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127b3bbe-f03a-4f51-b757-c3a142d90df6', 'volume_name': 'volume-127b3bbe-f03a-4f51-b757-c3a142d90df6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81377344-c34c-4d0b-b5b5-4612fab53b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81377344-c34c-4d0b-b5b5-4612fab53b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84fbc0d-cda2-4ba9-8c8f-94479cb5e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:30 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Volume 127b3bbe-f03a-4f51-b757-c3a142d90df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127b3bbe-f03a-4f51-b757-c3a142d90df6', 'volume_size': 1} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-523377329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127b3bbe-f03a-4f51-b757-c3a142d90df6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c232878aa45c48d4a1cdb1828c7045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:30Z,use_quota=True,user_id='2642fbdad69141aa96e759629ee2e142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Creating volume 127b3bbe-f03a-4f51-b757-c3a142d90df6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:30 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:30 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 1073741824 Jul 07 10:46:30 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:31 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 1073741824" returned: 0 in 0.909s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:31 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 Jul 07 10:46:31 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:32 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6" returned: 0 in 0.718s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84fbc0d-cda2-4ba9-8c8f-94479cb5e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127b3bbe-f03a-4f51-b757-c3a142d90df6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46959102-f1d5-43b3-bb0b-5b4ccdc49631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:32 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Volume volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 (127b3bbe-f03a-4f51-b757-c3a142d90df6): created successfully Jul 07 10:46:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46959102-f1d5-43b3-bb0b-5b4ccdc49631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Flow 'volume_create_manager' (120cb2f8-167d-4abf-8d7e-23b88ebdc84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:32 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a86986c9-6ae2-4441-a64c-ea96aa514aba tempest-VolumesListTestJSON-2081660205 None] Created volume successfully. Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Flow 'volume_create_manager' (4deb67c0-9eeb-43aa-b388-befba8207abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c3bd2-7570-4dbb-b4ba-2b4246f1c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c3bd2-7570-4dbb-b4ba-2b4246f1c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1553813199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8f2f2d-d9b3-4ec3-840f-e00cd641727a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c232878aa45c48d4a1cdb1828c7045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:33Z,use_quota=True,user_id='2642fbdad69141aa96e759629ee2e142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfc6c08-d8ce-44e7-8c72-e1d4c37df5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfc6c08-d8ce-44e7-8c72-e1d4c37df5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f1a4ea-3c0b-48fe-b8fc-03dfbc64d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f1a4ea-3c0b-48fe-b8fc-03dfbc64d806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8f2f2d-d9b3-4ec3-840f-e00cd641727a', 'volume_name': 'volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd859978-401c-4b58-b042-b3a6e9d0e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd859978-401c-4b58-b042-b3a6e9d0e630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbbf16a-1f24-4a8a-8b26-476569f278e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Volume 6c8f2f2d-d9b3-4ec3-840f-e00cd641727a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a', 'volume_size': 1} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1553813199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8f2f2d-d9b3-4ec3-840f-e00cd641727a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c232878aa45c48d4a1cdb1828c7045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:33Z,use_quota=True,user_id='2642fbdad69141aa96e759629ee2e142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Creating volume 6c8f2f2d-d9b3-4ec3-840f-e00cd641727a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:33 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:33 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a 1073741824 Jul 07 10:46:33 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Flow 'volume_create_manager' (b46383b3-966f-4d92-a044-5ea1c392bac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57df1bf7-a099-483b-90d9-b40434ed9b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57df1bf7-a099-483b-90d9-b40434ed9b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-184648188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95a2706-de2d-4991-a8cd-32f30662333a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e53b5fe0ff643af8940f55e4a347cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:33Z,use_quota=True,user_id='d579afb31375455d9df02a5bf41a75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31de2b0-247e-4957-ba04-d8b909e30a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31de2b0-247e-4957-ba04-d8b909e30a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69704986-cd28-456a-8078-b2dcbcd87384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69704986-cd28-456a-8078-b2dcbcd87384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95a2706-de2d-4991-a8cd-32f30662333a', 'volume_name': 'volume-c95a2706-de2d-4991-a8cd-32f30662333a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8216e409-c8f9-4298-b2eb-e01143975de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8216e409-c8f9-4298-b2eb-e01143975de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f87a8c-011d-4482-b6d4-1438e44cde2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:33 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Volume c95a2706-de2d-4991-a8cd-32f30662333a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95a2706-de2d-4991-a8cd-32f30662333a', 'volume_size': 1} Jul 07 10:46:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:34 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a 1073741824" returned: 0 in 0.859s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:34 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a Jul 07 10:46:34 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:34 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a" returned: 0 in 0.653s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-184648188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95a2706-de2d-4991-a8cd-32f30662333a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e53b5fe0ff643af8940f55e4a347cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:33Z,use_quota=True,user_id='d579afb31375455d9df02a5bf41a75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Creating volume c95a2706-de2d-4991-a8cd-32f30662333a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:34 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbbf16a-1f24-4a8a-8b26-476569f278e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:34 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a 1073741824 Jul 07 10:46:34 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67ac0ac-6be5-4c42-89ea-99f67fc385ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:34 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Volume volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a (6c8f2f2d-d9b3-4ec3-840f-e00cd641727a): created successfully Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67ac0ac-6be5-4c42-89ea-99f67fc385ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Flow 'volume_create_manager' (4deb67c0-9eeb-43aa-b388-befba8207abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:34 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bec11c38-4904-4e5a-9dfa-203be9c1a9a3 tempest-VolumesListTestJSON-2081660205 None] Created volume successfully. Jul 07 10:46:35 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a 1073741824" returned: 0 in 1.129s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:35 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a Jul 07 10:46:35 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:35 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Flow 'volume_create_manager' (a5522578-a12b-4a26-a8e6-753932b09f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9d504-a52f-4b71-9b65-c509e003c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9d504-a52f-4b71-9b65-c509e003c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296197402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeead2ca-6aef-4b1d-8f14-4bdf93e74a43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c232878aa45c48d4a1cdb1828c7045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:36Z,use_quota=True,user_id='2642fbdad69141aa96e759629ee2e142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ecbec5-80be-4998-abbd-83fe4c92dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ecbec5-80be-4998-abbd-83fe4c92dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d053affe-1549-48ca-acdd-eaa953b73374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d053affe-1549-48ca-acdd-eaa953b73374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeead2ca-6aef-4b1d-8f14-4bdf93e74a43', 'volume_name': 'volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e29842-a133-4f5a-bd98-e971b0079590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e29842-a133-4f5a-bd98-e971b0079590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8dedd9-b034-40f1-9c09-6f9fcfe0b698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Volume eeead2ca-6aef-4b1d-8f14-4bdf93e74a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43', 'volume_size': 1} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:36 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296197402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeead2ca-6aef-4b1d-8f14-4bdf93e74a43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c232878aa45c48d4a1cdb1828c7045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:36Z,use_quota=True,user_id='2642fbdad69141aa96e759629ee2e142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Creating volume eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:36 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:36 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 1073741824 Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f87a8c-011d-4482-b6d4-1438e44cde2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95a2706-de2d-4991-a8cd-32f30662333a', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:36 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63caef9f-17cd-475b-875b-808d968be05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Volume volume-c95a2706-de2d-4991-a8cd-32f30662333a (c95a2706-de2d-4991-a8cd-32f30662333a): created successfully Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63caef9f-17cd-475b-875b-808d968be05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Flow 'volume_create_manager' (b46383b3-966f-4d92-a044-5ea1c392bac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b4600324-457a-4945-89c5-f418865766ef tempest-AbsoluteLimitsTests-428361564 None] Created volume successfully. Jul 07 10:46:37 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 1073741824" returned: 0 in 0.840s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=110,cinder:SELECT=102,cinder:INSERT=36,cinder:DELETE=6 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:37 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 Jul 07 10:46:37 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Acquiring lock "cinder-c95a2706-de2d-4991-a8cd-32f30662333a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Lock "cinder-c95a2706-de2d-4991-a8cd-32f30662333a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Acquiring lock "cinder-quobyte-c95a2706-de2d-4991-a8cd-32f30662333a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Lock "cinder-quobyte-c95a2706-de2d-4991-a8cd-32f30662333a" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76cf3f4-a334-42eb-906a-320bd59dc967]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:37 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a Jul 07 10:46:37 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:38 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=116,cinder:INSERT=38,cinder:DELETE=13,cinder:SELECT=87 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8dedd9-b034-40f1-9c09-6f9fcfe0b698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b4f286-65d3-4135-92fb-158542d84295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Volume volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 (eeead2ca-6aef-4b1d-8f14-4bdf93e74a43): created successfully Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b4f286-65d3-4135-92fb-158542d84295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Flow 'volume_create_manager' (a5522578-a12b-4a26-a8e6-753932b09f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-150fcda4-388f-41d3-b237-7b3c4b2bd0bf tempest-VolumesListTestJSON-2081660205 None] Created volume successfully. Jul 07 10:46:38 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a" returned: 0 in 0.868s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:38 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a Jul 07 10:46:38 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:39 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c95a2706-de2d-4991-a8cd-32f30662333a" returned: 0 in 0.671s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Lock "cinder-quobyte-c95a2706-de2d-4991-a8cd-32f30662333a" released by "delete_volume" :: held 1.597s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Created reservations ['1378f8b8-e352-4288-a18c-6f8170514cff', 'cc9b92c6-ad04-411e-91d2-17f5367917b6', 'f796c07b-13bd-49fb-be5c-0cad35ac474a', '75a75cd8-083e-4ce3-a175-819e9e506ac7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:39 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:39 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:40 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:40 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Deleted volume successfully. Jul 07 10:46:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ddbc81f-2767-4c64-9e8d-3975eecac0a6 tempest-AbsoluteLimitsTests-428361564 None] Lock "cinder-c95a2706-de2d-4991-a8cd-32f30662333a-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "cinder-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "cinder-quobyte-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-quobyte-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319e6bb-2b7c-4c6e-bb49-5f8bacb92ee4]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:42 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 Jul 07 10:46:42 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:42 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43" returned: 0 in 0.873s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:42 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43 Jul 07 10:46:42 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Flow 'volume_create_manager' (9de04bf9-66ee-4afe-a570-c1a85fc7c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17024c52-28e0-422b-b4ff-864829188663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17024c52-28e0-422b-b4ff-864829188663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480153839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cc5176-8818-4173-9a8f-36ffb84bcbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b4f309e3204494a70710a771a194b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:43Z,use_quota=True,user_id='0789d6f4732141a8af7c7db686b17124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8cd8ef-a59b-4454-8187-ca527c6ee7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8cd8ef-a59b-4454-8187-ca527c6ee7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f859039-5eb3-4f91-a806-f7ce1855f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f859039-5eb3-4f91-a806-f7ce1855f01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cc5176-8818-4173-9a8f-36ffb84bcbb9', 'volume_name': 'volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cf42f6-3b55-4c3c-b8b0-c26c14092364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cf42f6-3b55-4c3c-b8b0-c26c14092364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6463cfb6-c383-4923-b399-a6c5d7540633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Volume 96cc5176-8818-4173-9a8f-36ffb84bcbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9', 'volume_size': 1} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480153839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cc5176-8818-4173-9a8f-36ffb84bcbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b4f309e3204494a70710a771a194b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:43Z,use_quota=True,user_id='0789d6f4732141a8af7c7db686b17124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Creating volume 96cc5176-8818-4173-9a8f-36ffb84bcbb9 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:43 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:43 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 1073741824 Jul 07 10:46:43 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Flow 'volume_create_manager' (b0213897-23bc-4491-a677-006c3e8e1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d523e60-aa92-4ee7-bc17-18ee24134c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d523e60-aa92-4ee7-bc17-18ee24134c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-914574905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4c65f0-f0a2-40c4-9cc7-415be90830e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b4f309e3204494a70710a771a194b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:44Z,use_quota=True,user_id='0789d6f4732141a8af7c7db686b17124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2648d874-520b-4d27-ab8b-e0e6365aeda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2648d874-520b-4d27-ab8b-e0e6365aeda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f28a2-583f-4d5d-8fa7-bd23d85de642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f28a2-583f-4d5d-8fa7-bd23d85de642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4c65f0-f0a2-40c4-9cc7-415be90830e4', 'volume_name': 'volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacf44fc-2637-4d45-849b-5abc7fde239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacf44fc-2637-4d45-849b-5abc7fde239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5746767-e3e3-445a-b662-7a5f526b9024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Volume 7b4c65f0-f0a2-40c4-9cc7-415be90830e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4', 'volume_size': 1} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43" returned: 0 in 0.980s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-quobyte-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43" released by "delete_volume" :: held 1.907s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Created reservations ['4afff52a-d4c7-4256-bd38-0ed240e0df29', 'b9eb9ee2-16be-473e-99f8-43ee42e0f374', '15903d62-c737-4f9c-9817-c5297cbef6fd', 'd1ce25f4-6c65-461e-9850-db8b072da428'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:44 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:44 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "cinder-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "cinder-quobyte-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-quobyte-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb1ef1-4c79-4a02-bba9-3a553de6f1f5]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:44 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a Jul 07 10:46:44 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:44 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 1073741824" returned: 0 in 1.395s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:44 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 Jul 07 10:46:44 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:45 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.113s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Deleted volume successfully. Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e0138440-ea09-4e72-beab-ed8923685750 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-eeead2ca-6aef-4b1d-8f14-4bdf93e74a43-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:45 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a" returned: 0 in 1.086s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:45 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a Jul 07 10:46:45 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:45 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9" returned: 0 in 0.861s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-914574905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4c65f0-f0a2-40c4-9cc7-415be90830e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b4f309e3204494a70710a771a194b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:44Z,use_quota=True,user_id='0789d6f4732141a8af7c7db686b17124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Creating volume 7b4c65f0-f0a2-40c4-9cc7-415be90830e4 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:45 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6463cfb6-c383-4923-b399-a6c5d7540633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f571564e-1f19-401e-a469-0b3e6ad9f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:45 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 1073741824 Jul 07 10:46:45 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:45 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Volume volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 (96cc5176-8818-4173-9a8f-36ffb84bcbb9): created successfully Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f571564e-1f19-401e-a469-0b3e6ad9f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Flow 'volume_create_manager' (9de04bf9-66ee-4afe-a570-c1a85fc7c325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-62f9346f-be8e-430e-b074-67a55473bc90 tempest-TestServerVolumeAttachmentScenario-742092418 None] Created volume successfully. Jul 07 10:46:46 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a" returned: 0 in 0.713s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-quobyte-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a" released by "delete_volume" :: held 1.855s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Created reservations ['0f385eee-037a-4935-b621-946cc0cb5fed', 'f5e82f49-592a-4a19-8cb4-28ba495ed660', 'dafdd248-888a-434a-86dd-21ffdffb9033', '7f724903-be7d-467d-8d2c-dd19c1667569'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:46 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:46 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "cinder-127b3bbe-f03a-4f51-b757-c3a142d90df6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-127b3bbe-f03a-4f51-b757-c3a142d90df6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "cinder-quobyte-127b3bbe-f03a-4f51-b757-c3a142d90df6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:46 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 1073741824" returned: 0 in 1.110s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-quobyte-127b3bbe-f03a-4f51-b757-c3a142d90df6" acquired by "delete_volume" :: waited 0.041s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54066713-4b22-4155-a84c-793512e9a5f3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:46 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 Jul 07 10:46:46 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:47 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 Jul 07 10:46:47 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Flow 'volume_create_manager' (98c58288-3292-4939-aec0-cf53a6f8622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d48b8aa-e06c-4e55-972e-a224a49dd151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d48b8aa-e06c-4e55-972e-a224a49dd151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-397220003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832774f6-6c65-485b-bb5e-4986dda86ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35efe1073d3d475e97a0f3d105b5fe1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:47Z,use_quota=True,user_id='e7c62f5235c341149939bbaaaa3c6cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:47 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922a04f7-caa6-4606-94cc-957a2bdbdfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922a04f7-caa6-4606-94cc-957a2bdbdfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22267b8b-760c-4fa7-9fac-42bf6d275c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22267b8b-760c-4fa7-9fac-42bf6d275c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832774f6-6c65-485b-bb5e-4986dda86ebf', 'volume_name': 'volume-832774f6-6c65-485b-bb5e-4986dda86ebf', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1e6aca-bd40-4796-aa80-7d31b7d46f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1e6aca-bd40-4796-aa80-7d31b7d46f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a066797c-44c9-42e7-9c03-b59e2b33449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Volume 832774f6-6c65-485b-bb5e-4986dda86ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832774f6-6c65-485b-bb5e-4986dda86ebf', 'volume_size': 1} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.948s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Deleted volume successfully. Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c508fc2d-3626-4f52-ba76-31cd8ab727b5 tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-6c8f2f2d-d9b3-4ec3-840f-e00cd641727a-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:47 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6" returned: 0 in 0.938s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:47 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4" returned: 0 in 0.947s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-397220003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832774f6-6c65-485b-bb5e-4986dda86ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35efe1073d3d475e97a0f3d105b5fe1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:47Z,use_quota=True,user_id='e7c62f5235c341149939bbaaaa3c6cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Creating volume 832774f6-6c65-485b-bb5e-4986dda86ebf {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:47 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6 Jul 07 10:46:47 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:47 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:47 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf 1073741824 Jul 07 10:46:47 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5746767-e3e3-445a-b662-7a5f526b9024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f87352-c7b5-4e2f-b4aa-ac68aa0bc5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Volume volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 (7b4c65f0-f0a2-40c4-9cc7-415be90830e4): created successfully Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f87352-c7b5-4e2f-b4aa-ac68aa0bc5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Flow 'volume_create_manager' (b0213897-23bc-4491-a677-006c3e8e1906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-56bb9e91-247c-4da5-bfa3-d992d9f18b3c tempest-TestServerVolumeAttachmentScenario-742092418 None] Created volume successfully. Jul 07 10:46:48 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-127b3bbe-f03a-4f51-b757-c3a142d90df6" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-quobyte-127b3bbe-f03a-4f51-b757-c3a142d90df6" released by "delete_volume" :: held 1.770s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Created reservations ['799ead1b-f7a0-4f10-badc-b4cf243e7dc9', '97660c8d-3e7d-47ef-85f0-266677e319e4', '863132ab-8b9d-47e8-bf1c-2a9bd18a7dbc', 'd33174d0-44b0-49c1-816e-99939c055536'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:48 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf 1073741824" returned: 0 in 0.825s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:48 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:48 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:48 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf Jul 07 10:46:48 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:49 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.755s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Deleted volume successfully. Jul 07 10:46:49 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a066797c-44c9-42e7-9c03-b59e2b33449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832774f6-6c65-485b-bb5e-4986dda86ebf', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427e6b04-7a0f-48d8-a980-f949d4e840eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0d9aaff-8ecd-488c-acd6-21e6dd550fae tempest-VolumesListTestJSON-2081660205 None] Lock "cinder-127b3bbe-f03a-4f51-b757-c3a142d90df6-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:49 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Volume volume-832774f6-6c65-485b-bb5e-4986dda86ebf (832774f6-6c65-485b-bb5e-4986dda86ebf): created successfully Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427e6b04-7a0f-48d8-a980-f949d4e840eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Flow 'volume_create_manager' (98c58288-3292-4939-aec0-cf53a6f8622f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-98ccb1e5-fd41-49f4-bf21-045976a28deb tempest-VolumesTransfersTest-1484651311 None] Created volume successfully. Jul 07 10:46:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-61c9e989-b56d-44bc-aaa8-0735579a0c7f tempest-VolumesTransfersTest-275401851 None] Transfer volume completed successfully. Jul 07 10:46:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Acquiring lock "cinder-832774f6-6c65-485b-bb5e-4986dda86ebf-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-832774f6-6c65-485b-bb5e-4986dda86ebf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Acquiring lock "cinder-quobyte-832774f6-6c65-485b-bb5e-4986dda86ebf" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-quobyte-832774f6-6c65-485b-bb5e-4986dda86ebf" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9f1712-073d-4e2f-9d3d-be7c4009b820]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:52 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf Jul 07 10:46:52 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:53 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf" returned: 0 in 0.868s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:53 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf Jul 07 10:46:53 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:53 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-832774f6-6c65-485b-bb5e-4986dda86ebf" returned: 0 in 0.742s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-quobyte-832774f6-6c65-485b-bb5e-4986dda86ebf" released by "delete_volume" :: held 1.667s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:53 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Created reservations ['05fd0122-163a-489c-a4c1-792766b8c046', '6881ed54-9502-4e8d-99ba-d32191a3a157', 'c245a4c2-ab31-45e5-804f-d80b7a2b3c9d', 'ac8a65a9-0fe8-441c-b481-04b99dd1f27c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:54 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:54 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:54 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.911s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:54 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:46:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Deleted volume successfully. Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2a49b5ce-53a0-4360-a094-40a9e251d9f4 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-832774f6-6c65-485b-bb5e-4986dda86ebf-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Flow 'volume_create_manager' (9f337319-1fde-4523-b1c7-8d578f6e0b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728cdf0-aaec-4259-9b1c-2b5e440e2572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728cdf0-aaec-4259-9b1c-2b5e440e2572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1717384372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5adf6e-5ada-4011-af56-5f2625d335ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35efe1073d3d475e97a0f3d105b5fe1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:55Z,use_quota=True,user_id='e7c62f5235c341149939bbaaaa3c6cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400ce3e0-b838-4c05-a821-520d4a551dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400ce3e0-b838-4c05-a821-520d4a551dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62af0378-5986-4001-a123-c9840ce437f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62af0378-5986-4001-a123-c9840ce437f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5adf6e-5ada-4011-af56-5f2625d335ff', 'volume_name': 'volume-6a5adf6e-5ada-4011-af56-5f2625d335ff', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7238500f-d07c-4d21-a62b-00025401e913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7238500f-d07c-4d21-a62b-00025401e913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b1f048-17e5-4350-8fdd-feaa6ce995e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Volume 6a5adf6e-5ada-4011-af56-5f2625d335ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5adf6e-5ada-4011-af56-5f2625d335ff', 'volume_size': 1} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1717384372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5adf6e-5ada-4011-af56-5f2625d335ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35efe1073d3d475e97a0f3d105b5fe1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:46:55Z,use_quota=True,user_id='e7c62f5235c341149939bbaaaa3c6cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Creating volume 6a5adf6e-5ada-4011-af56-5f2625d335ff {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:46:55 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:46:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:55 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff 1073741824 Jul 07 10:46:55 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:56 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff 1073741824" returned: 0 in 0.917s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:56 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff Jul 07 10:46:56 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:57 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff" returned: 0 in 0.759s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b1f048-17e5-4350-8fdd-feaa6ce995e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5adf6e-5ada-4011-af56-5f2625d335ff', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c107e21-38de-40d0-9613-7b3e27b3a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:46:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Volume volume-6a5adf6e-5ada-4011-af56-5f2625d335ff (6a5adf6e-5ada-4011-af56-5f2625d335ff): created successfully Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c107e21-38de-40d0-9613-7b3e27b3a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Flow 'volume_create_manager' (9f337319-1fde-4523-b1c7-8d578f6e0b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:46:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e2e152fe-e4a4-44a1-840b-2c93b1c51cdd tempest-VolumesTransfersTest-1484651311 None] Created volume successfully. Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Acquiring lock "cinder-6a5adf6e-5ada-4011-af56-5f2625d335ff-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-6a5adf6e-5ada-4011-af56-5f2625d335ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Acquiring lock "cinder-quobyte-6a5adf6e-5ada-4011-af56-5f2625d335ff" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-quobyte-6a5adf6e-5ada-4011-af56-5f2625d335ff" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e7bf3-2a38-47a3-879a-66a75524f8b0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:46:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:57 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff Jul 07 10:46:57 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:58 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff" returned: 0 in 0.979s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:58 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff Jul 07 10:46:58 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:46:59 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6a5adf6e-5ada-4011-af56-5f2625d335ff" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-quobyte-6a5adf6e-5ada-4011-af56-5f2625d335ff" released by "delete_volume" :: held 1.791s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Created reservations ['78bb60e4-9d62-4cf9-aa23-bc9da0fdabb5', '14d03f0f-38db-4baa-9cf2-f5f55ee095d3', '3bec710a-ec8b-444c-844f-7e763f0abd17', 'cc5323de-ecaf-4feb-826f-ef7868410e8c'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:46:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:46:59 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:46:59 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:00 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.997s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:00 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:47:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Deleted volume successfully. Jul 07 10:47:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b092c447-be43-45eb-b91f-4dc64d4e83f8 tempest-VolumesTransfersTest-1239325241 None] Lock "cinder-6a5adf6e-5ada-4011-af56-5f2625d335ff-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (bedb812b-32ff-4e64-8c66-abd2afc69b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d259b2cb-b6f1-48b8-bda6-06fecad913ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d259b2cb-b6f1-48b8-bda6-06fecad913ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974613808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbf3e49-9f63-436a-bce1-56ab32e40d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:06Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d581dad-ab7a-4409-85d9-c990313e9670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d581dad-ab7a-4409-85d9-c990313e9670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d008b3-942a-4227-b08f-e5d8134050f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d008b3-942a-4227-b08f-e5d8134050f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abbf3e49-9f63-436a-bce1-56ab32e40d11', 'volume_name': 'volume-abbf3e49-9f63-436a-bce1-56ab32e40d11', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b49e5-6119-4d62-a230-6add839a7572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b49e5-6119-4d62-a230-6add839a7572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c200861b-67fa-413f-96e1-bb1a6f24a888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:05 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Volume abbf3e49-9f63-436a-bce1-56ab32e40d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abbf3e49-9f63-436a-bce1-56ab32e40d11', 'volume_size': 1} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974613808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbf3e49-9f63-436a-bce1-56ab32e40d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:06Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Creating volume abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:47:05 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:47:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:05 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 1073741824 Jul 07 10:47:05 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:06 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 1073741824" returned: 0 in 1.055s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:07 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 Jul 07 10:47:07 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:07 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11" returned: 0 in 0.925s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:47:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c200861b-67fa-413f-96e1-bb1a6f24a888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abbf3e49-9f63-436a-bce1-56ab32e40d11', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a831f5ad-315b-4e62-911a-f7d9fb155b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:07 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Volume volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 (abbf3e49-9f63-436a-bce1-56ab32e40d11): created successfully Jul 07 10:47:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a831f5ad-315b-4e62-911a-f7d9fb155b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (bedb812b-32ff-4e64-8c66-abd2afc69b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:08 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-455a8944-c564-4ded-81d6-81456a6c6460 tempest-VolumesSnapshotTestJSON-1354762993 None] Created volume successfully. Jul 07 10:47:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Creating offline snapshot 2ece4d70-cc88-421c-8a57-d7e466e68aa6 of volume abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:47:09 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8068f498-9e4a-4683-98c4-3dcfd9073b6c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:09 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 Jul 07 10:47:09 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:10 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11" returned: 0 in 0.773s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:10 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 1G Jul 07 10:47:10 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:11 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 1G" returned: 0 in 1.149s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:11 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 Jul 07 10:47:11 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:12 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6" returned: 0 in 0.855s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:12 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 is being set with open permissions: ugo+rw Jul 07 10:47:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:12 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 Jul 07 10:47:12 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:13 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6" returned: 0 in 0.847s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:13 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.info Jul 07 10:47:13 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:13 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.info" returned: 0 in 0.755s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:13 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.info is being set with open permissions: ugo+rw Jul 07 10:47:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:13 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.info Jul 07 10:47:13 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:14 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.info" returned: 0 in 0.793s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.305s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f299a617-28dd-48f6-8843-c198b0829abd tempest-VolumesSnapshotTestJSON-1354762993 None] Create snapshot completed successfully Jul 07 10:47:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-2ece4d70-cc88-421c-8a57-d7e466e68aa6-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-2ece4d70-cc88-421c-8a57-d7e466e68aa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-abbf3e49-9f63-436a-bce1-56ab32e40d11" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-abbf3e49-9f63-436a-bce1-56ab32e40d11" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-2ece4d70-cc88-421c-8a57-d7e466e68aa6" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-2ece4d70-cc88-421c-8a57-d7e466e68aa6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Deleting offline snapshot 2ece4d70-cc88-421c-8a57-d7e466e68aa6 of volume abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] snapshot_file for this snap is: volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f26683-3ebc-49fc-83dc-248dcd1fe903]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:16 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 Jul 07 10:47:16 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:16 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6" returned: 0 in 0.878s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abbf3e49-9f63-436a-bce1-56ab32e40d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d747ac39-654d-4864-891c-94f82404eb18]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:17 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 Jul 07 10:47:17 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Flow 'volume_create_manager' (8c4d5485-4e2a-4edf-9130-28a4f77d2217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f796c94-6f47-415b-84b1-14d52b5a8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f796c94-6f47-415b-84b1-14d52b5a8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-399627945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b911865f-67ac-4446-9597-42521d49e7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa4f2548b414f48afc3f9125970493c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:17Z,use_quota=True,user_id='0eab837e5e7d4386bff58f535fbb1671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ee9746-1449-4c94-9dfc-ec674942f5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ee9746-1449-4c94-9dfc-ec674942f5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c840e2-ea61-496e-b0b6-2ed48e38c732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c840e2-ea61-496e-b0b6-2ed48e38c732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b911865f-67ac-4446-9597-42521d49e7d6', 'volume_name': 'volume-b911865f-67ac-4446-9597-42521d49e7d6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90e672d-85f6-4e34-adaf-f0d1c1b724c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90e672d-85f6-4e34-adaf-f0d1c1b724c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cbf73-441b-46b3-a0d7-598c3bb79cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:17 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Volume b911865f-67ac-4446-9597-42521d49e7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b911865f-67ac-4446-9597-42521d49e7d6', 'volume_size': 1} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-399627945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b911865f-67ac-4446-9597-42521d49e7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa4f2548b414f48afc3f9125970493c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:17Z,use_quota=True,user_id='0eab837e5e7d4386bff58f535fbb1671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Creating volume b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:47:17 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:17 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 1073741824 Jul 07 10:47:17 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:17 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11" returned: 0 in 0.790s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:17 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 Jul 07 10:47:17 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:18 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 1073741824" returned: 0 in 0.803s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:18 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:47:18 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:18 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6" returned: 0 in 0.776s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:18 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6 Jul 07 10:47:18 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:19 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 0.637s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cbf73-441b-46b3-a0d7-598c3bb79cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b911865f-67ac-4446-9597-42521d49e7d6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1bac35-3f2d-4ea1-b3d9-8e26ebdc4fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:19 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Volume volume-b911865f-67ac-4446-9597-42521d49e7d6 (b911865f-67ac-4446-9597-42521d49e7d6): created successfully Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1bac35-3f2d-4ea1-b3d9-8e26ebdc4fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Flow 'volume_create_manager' (8c4d5485-4e2a-4edf-9130-28a4f77d2217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-208850c8-b446-4554-bd37-bafe3fc3d76c tempest-VolumesActionsTest-1049792614 None] Created volume successfully. Jul 07 10:47:19 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11.2ece4d70-cc88-421c-8a57-d7e466e68aa6" returned: 0 in 0.646s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-2ece4d70-cc88-421c-8a57-d7e466e68aa6" released by "_delete_snapshot" :: held 3.231s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-abbf3e49-9f63-436a-bce1-56ab32e40d11" released by "delete_snapshot" :: held 3.256s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['8fb6624f-44b3-414c-a5fe-a0af15e25091', '50349f62-659c-4438-9da4-00294ddacd52', 'a28328f9-eeca-47bf-8e9d-2542fe3a1353', '321fc64a-6145-4f86-bbc3-7626205334fb'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:47:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Delete snapshot completed successfully. Jul 07 10:47:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-037d3f0d-a2fa-4ad4-b189-603ed273e2fc tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-2ece4d70-cc88-421c-8a57-d7e466e68aa6-delete_snapshot" released by "delete_snapshot" :: held 3.433s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (679268b1-4ecf-488e-a973-95aeb009108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff7dea4-a5be-4574-88a1-6117264b0f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff7dea4-a5be-4574-88a1-6117264b0f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-915029764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191da070-3cb6-4cad-8227-a6a6fed24fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:21Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a286b08-7c06-452e-a508-052edd92d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a286b08-7c06-452e-a508-052edd92d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd79495-6c1c-4224-826d-7586eee47baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd79495-6c1c-4224-826d-7586eee47baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191da070-3cb6-4cad-8227-a6a6fed24fa5', 'volume_name': 'volume-191da070-3cb6-4cad-8227-a6a6fed24fa5', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456de21a-8b90-4c74-b938-05110f3f01c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456de21a-8b90-4c74-b938-05110f3f01c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df839f11-efc4-479b-b8a0-e9b5eb785e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:20 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Volume 191da070-3cb6-4cad-8227-a6a6fed24fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191da070-3cb6-4cad-8227-a6a6fed24fa5', 'volume_size': 1} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-915029764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191da070-3cb6-4cad-8227-a6a6fed24fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:21Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Creating volume 191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:47:20 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:47:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:21 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 1073741824 Jul 07 10:47:21 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:21 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 1073741824" returned: 0 in 0.881s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:21 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 Jul 07 10:47:21 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:22 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5" returned: 0 in 0.727s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:47:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df839f11-efc4-479b-b8a0-e9b5eb785e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191da070-3cb6-4cad-8227-a6a6fed24fa5', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6828647-a829-4f85-98fd-807fe92a955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:22 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Volume volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 (191da070-3cb6-4cad-8227-a6a6fed24fa5): created successfully Jul 07 10:47:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6828647-a829-4f85-98fd-807fe92a955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (679268b1-4ecf-488e-a973-95aeb009108a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:22 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d0a1e1ca-394b-47aa-aca7-0dab10c740be tempest-VolumesSnapshotTestJSON-1354762993 None] Created volume successfully. Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Creating offline snapshot a31911b6-bfff-4507-9a1a-1d1f039566c2 of volume 191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b92586-4cf2-440f-8a62-7f0a264010ea]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:23 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 Jul 07 10:47:23 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:23 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:47:23 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:23 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5" returned: 0 in 0.778s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:23 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 1G Jul 07 10:47:23 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:24 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.685s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:47:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:47:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:47:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:47:24 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 1G" returned: 0 in 0.801s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:24 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 Jul 07 10:47:24 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:25 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2" returned: 0 in 0.759s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:25 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 is being set with open permissions: ugo+rw Jul 07 10:47:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:25 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 Jul 07 10:47:25 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:26 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2" returned: 0 in 0.680s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:26 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.info Jul 07 10:47:26 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:26 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.info" returned: 0 in 0.773s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:26 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.info is being set with open permissions: ugo+rw Jul 07 10:47:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:26 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.info Jul 07 10:47:26 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:27 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.info" returned: 0 in 0.677s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.566s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8cbf8eb9-04bc-41f3-b01f-b93f6446fe5e tempest-VolumesSnapshotTestJSON-1354762993 None] Create snapshot completed successfully Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (9a39a686-a588-4e79-8b19-c523ec98afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bd70ea-1af4-4753-8d4e-d87c750aff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bd70ea-1af4-4753-8d4e-d87c750aff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1357600065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d88c083-7e72-4061-9689-bdf5f660ca7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a31911b6-bfff-4507-9a1a-1d1f039566c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:29Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9faa58-d435-4852-b3b1-bb3a16e42383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9faa58-d435-4852-b3b1-bb3a16e42383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaeffd64-b86c-4c4e-ad15-149e6a3a994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaeffd64-b86c-4c4e-ad15-149e6a3a994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d88c083-7e72-4061-9689-bdf5f660ca7a', 'volume_name': 'volume-1d88c083-7e72-4061-9689-bdf5f660ca7a', 'volume_size': 2, 'snapshot_id': 'a31911b6-bfff-4507-9a1a-1d1f039566c2'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb083b7-45ff-428e-8c4f-89c66c1a8424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb083b7-45ff-428e-8c4f-89c66c1a8424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee9bc80-270a-4999-8f87-c488162916b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:28 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Volume 1d88c083-7e72-4061-9689-bdf5f660ca7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d88c083-7e72-4061-9689-bdf5f660ca7a', 'volume_size': 2, 'snapshot_id': 'a31911b6-bfff-4507-9a1a-1d1f039566c2'} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-a31911b6-bfff-4507-9a1a-1d1f039566c2-1d88c083-7e72-4061-9689-bdf5f660ca7a" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-a31911b6-bfff-4507-9a1a-1d1f039566c2-1d88c083-7e72-4061-9689-bdf5f660ca7a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Creating volume 1d88c083-7e72-4061-9689-bdf5f660ca7a from snapshot a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-1d88c083-7e72-4061-9689-bdf5f660ca7a" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1d88c083-7e72-4061-9689-bdf5f660ca7a" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] snapshot: a31911b6-bfff-4507-9a1a-1d1f039566c2, volume: 1d88c083-7e72-4061-9689-bdf5f660ca7a, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[57840dff-607a-44df-9e0b-5553244fe71d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:29 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 Jul 07 10:47:29 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:29 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2" returned: 0 in 0.815s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-191da070-3cb6-4cad-8227-a6a6fed24fa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76fffc-b90d-4b69-936d-4c6f519aeba1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:29 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 Jul 07 10:47:29 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a5ae0ea3-7616-4b72-86be-9bf4b152469d req-13b456e3-094a-47eb-8590-a18c5c5a3c60 tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:30 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5" returned: 0 in 1.045s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:30 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:47:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:30 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a Jul 07 10:47:30 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9312af1f-51b7-4d12-b827-5c7fa084d891 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6" by "attach_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9312af1f-51b7-4d12-b827-5c7fa084d891 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6" acquired by "attach_volume" :: waited 0.045s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9312af1f-51b7-4d12-b827-5c7fa084d891 tempest-VolumesActionsTest-1049792614 None] Attaching volume b911865f-67ac-4446-9597-42521d49e7d6 to instance 3cb8c91d-e4d2-41c7-9688-7bd4d1869106 at mountpoint /dev/vdb on host None. Jul 07 10:47:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9312af1f-51b7-4d12-b827-5c7fa084d891 tempest-VolumesActionsTest-1049792614 None] Attach volume completed successfully. Jul 07 10:47:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9312af1f-51b7-4d12-b827-5c7fa084d891 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6" released by "attach_volume" :: held 0.359s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:37 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a" returned: 0 in 6.202s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad6f9a3-cade-440c-8c20-da32a103bf1a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-08debcc9-47dc-44e3-8d56-646e03bee3c8 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-detach_volume" by "detach_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-08debcc9-47dc-44e3-8d56-646e03bee3c8 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:37 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-08debcc9-47dc-44e3-8d56-646e03bee3c8 tempest-VolumesActionsTest-1049792614 None] Detaching volume b911865f-67ac-4446-9597-42521d49e7d6 from instance 3cb8c91d-e4d2-41c7-9688-7bd4d1869106. Jul 07 10:47:37 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 Jul 07 10:47:37 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:37 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-08debcc9-47dc-44e3-8d56-646e03bee3c8 tempest-VolumesActionsTest-1049792614 None] Detach volume completed successfully. Jul 07 10:47:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-08debcc9-47dc-44e3-8d56-646e03bee3c8 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:38 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5" returned: 0 in 0.985s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:47:38 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Converted 1024.00 MB image at 165.08 MB/s Jul 07 10:47:38 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a is being set with open permissions: ugo+rw Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:38 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a Jul 07 10:47:38 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:38 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a" returned: 0 in 0.673s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1d88c083-7e72-4061-9689-bdf5f660ca7a" released by "_copy_volume_from_snapshot" :: held 9.815s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-a31911b6-bfff-4507-9a1a-1d1f039566c2-1d88c083-7e72-4061-9689-bdf5f660ca7a" released by "_create_volume_from_snapshot" :: held 9.845s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.859s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a5ae0ea3-7616-4b72-86be-9bf4b152469d req-13b456e3-094a-47eb-8590-a18c5c5a3c60 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.495s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:DELETE=9,cinder:SELECT=76,cinder:INSERT=17,cinder:UPDATE=90 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[586dec60-446f-43b6-b947-09371ffbf3b7]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a5ae0ea3-7616-4b72-86be-9bf4b152469d req-13b456e3-094a-47eb-8590-a18c5c5a3c60 tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=70,cinder:UPDATE=75,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee9bc80-270a-4999-8f87-c488162916b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d88c083-7e72-4061-9689-bdf5f660ca7a', 'volume_size': 2, 'snapshot_id': 'a31911b6-bfff-4507-9a1a-1d1f039566c2'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7adf67-be8d-4238-bcd3-f50721c10f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Volume volume-1d88c083-7e72-4061-9689-bdf5f660ca7a (1d88c083-7e72-4061-9689-bdf5f660ca7a): created successfully Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7adf67-be8d-4238-bcd3-f50721c10f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (9a39a686-a588-4e79-8b19-c523ec98afb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-02c9155c-86e7-4145-847e-fe51cadddaca tempest-VolumesSnapshotTestJSON-1354762993 None] Created volume successfully. Jul 07 10:47:38 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 Jul 07 10:47:38 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-1d88c083-7e72-4061-9689-bdf5f660ca7a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-1d88c083-7e72-4061-9689-bdf5f660ca7a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-1d88c083-7e72-4061-9689-bdf5f660ca7a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1d88c083-7e72-4061-9689-bdf5f660ca7a" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[514b0aed-e7e3-4a7e-b16c-dc89c49fcd5b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:39 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a Jul 07 10:47:39 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:39 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a5ae0ea3-7616-4b72-86be-9bf4b152469d req-13b456e3-094a-47eb-8590-a18c5c5a3c60 tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9" returned: 0 in 0.876s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a5ae0ea3-7616-4b72-86be-9bf4b152469d req-13b456e3-094a-47eb-8590-a18c5c5a3c60 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.939s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-a5ae0ea3-7616-4b72-86be-9bf4b152469d req-13b456e3-094a-47eb-8590-a18c5c5a3c60 tempest-TestServerVolumeAttachmentScenario-742092418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e8a225f-dd2f-4dbb-865f-2975a9e66536', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:47:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-a5ae0ea3-7616-4b72-86be-9bf4b152469d req-13b456e3-094a-47eb-8590-a18c5c5a3c60 tempest-TestServerVolumeAttachmentScenario-742092418 None] attachment_update completed successfully. Jul 07 10:47:40 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a" returned: 0 in 0.880s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:40 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a Jul 07 10:47:40 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:41 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d88c083-7e72-4061-9689-bdf5f660ca7a" returned: 0 in 0.725s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1d88c083-7e72-4061-9689-bdf5f660ca7a" released by "delete_volume" :: held 1.645s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['321b5499-535b-4bce-8afe-48f541f6a861', 'fb367a56-89d9-4225-9bf4-cf29742a8022', '9d8f6a4a-8956-4b6a-8074-8cdb732bacef', 'a54cb3cb-3317-439d-8498-7831ff9f9711'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:41 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:47:41 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-a31911b6-bfff-4507-9a1a-1d1f039566c2-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-a31911b6-bfff-4507-9a1a-1d1f039566c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-191da070-3cb6-4cad-8227-a6a6fed24fa5" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-191da070-3cb6-4cad-8227-a6a6fed24fa5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-a31911b6-bfff-4507-9a1a-1d1f039566c2" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-a31911b6-bfff-4507-9a1a-1d1f039566c2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Deleting offline snapshot a31911b6-bfff-4507-9a1a-1d1f039566c2 of volume 191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] snapshot_file for this snap is: volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6caec-b456-471c-99ab-2a52ebd47f88]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:41 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 Jul 07 10:47:41 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:41 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.728s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:41 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:47:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Deleted volume successfully. Jul 07 10:47:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9831f68d-e5f6-4fd7-83e0-3a80f1fd6cdb tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-1d88c083-7e72-4061-9689-bdf5f660ca7a-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:42 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2" returned: 0 in 0.801s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-191da070-3cb6-4cad-8227-a6a6fed24fa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:47:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c1783-07c8-44cd-8cb2-593e4532cf6a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:42 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 Jul 07 10:47:42 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:43 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:43 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 Jul 07 10:47:43 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:44 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2" returned: 0 in 0.748s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:44 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2 Jul 07 10:47:44 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:44 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5.a31911b6-bfff-4507-9a1a-1d1f039566c2" returned: 0 in 0.663s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-a31911b6-bfff-4507-9a1a-1d1f039566c2" released by "_delete_snapshot" :: held 3.096s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-191da070-3cb6-4cad-8227-a6a6fed24fa5" released by "delete_snapshot" :: held 3.124s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:44 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['e2215f30-efad-4c77-8ba1-c184b00518ef', 'a9495357-7db6-469f-b943-5fe8228a10dd', '689b124d-89cd-4bfa-ba6c-3894e2e0b1b4', '301fa738-f711-433d-8419-12d8475f1baf'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:47:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Delete snapshot completed successfully. Jul 07 10:47:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-aa13613a-2780-4917-8ef7-8b4cff815cbd tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-a31911b6-bfff-4507-9a1a-1d1f039566c2-delete_snapshot" released by "delete_snapshot" :: held 3.268s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-191da070-3cb6-4cad-8227-a6a6fed24fa5-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-191da070-3cb6-4cad-8227-a6a6fed24fa5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-191da070-3cb6-4cad-8227-a6a6fed24fa5" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-191da070-3cb6-4cad-8227-a6a6fed24fa5" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ce721a-7b40-481a-94a4-e5cddb54541c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:46 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 Jul 07 10:47:46 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:46 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5" returned: 0 in 0.795s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:47 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5 Jul 07 10:47:47 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:47 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-191da070-3cb6-4cad-8227-a6a6fed24fa5" returned: 0 in 0.658s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-191da070-3cb6-4cad-8227-a6a6fed24fa5" released by "delete_volume" :: held 1.526s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['58d115a5-f9a2-4490-a26a-c92c51ca4fd7', '5d1584ae-1fad-4846-9640-7286925336fd', 'c097c320-9e73-4d97-b186-029d4df2acd3', '899d234b-8ffc-40c4-a6c9-c72292b7f183'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:47 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:47:47 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:48 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.682s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:47:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Deleted volume successfully. Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c3431ba2-0ba2-454c-9af0-6c877b7dbb21 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-191da070-3cb6-4cad-8227-a6a6fed24fa5-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (fb52e001-1081-410e-9bc9-bbc43940c9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611f0089-3dca-4019-b882-19fbb4535818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611f0089-3dca-4019-b882-19fbb4535818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1298143328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04a83dc-8b3d-4844-a06a-0160ec1e5986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:49Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eccff8e-302b-4237-b4ae-d75005cf295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eccff8e-302b-4237-b4ae-d75005cf295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48758e16-c9b5-4d2c-be81-2b9bec91395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48758e16-c9b5-4d2c-be81-2b9bec91395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04a83dc-8b3d-4844-a06a-0160ec1e5986', 'volume_name': 'volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa94c32-fd0b-4397-acab-1a4270e09e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa94c32-fd0b-4397-acab-1a4270e09e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27facb16-28ba-4a7f-84ab-7765b9ad0dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Volume e04a83dc-8b3d-4844-a06a-0160ec1e5986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986', 'volume_size': 1} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1298143328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04a83dc-8b3d-4844-a06a-0160ec1e5986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:49Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Creating volume e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:47:48 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:47:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:48 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 1073741824 Jul 07 10:47:48 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-d8945ad6-4bbc-4187-9cf8-e580bd89ec57 req-6e3c1280-3b55-4f11-b32b-416b3212a436 tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:49 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 1073741824" returned: 0 in 0.882s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:49 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 Jul 07 10:47:49 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:50 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986" returned: 0 in 0.650s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-d8945ad6-4bbc-4187-9cf8-e580bd89ec57 req-6e3c1280-3b55-4f11-b32b-416b3212a436 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.809s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27facb16-28ba-4a7f-84ab-7765b9ad0dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad8ea48-9014-463f-8117-dc644991b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74bff1-e8c7-4b32-99eb-6f17987b449c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-d8945ad6-4bbc-4187-9cf8-e580bd89ec57 req-6e3c1280-3b55-4f11-b32b-416b3212a436 tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:50 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Volume volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 (e04a83dc-8b3d-4844-a06a-0160ec1e5986): created successfully Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad8ea48-9014-463f-8117-dc644991b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (fb52e001-1081-410e-9bc9-bbc43940c9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-981920e4-cb60-491d-9e2c-074d450a88ac tempest-VolumesSnapshotTestJSON-1354762993 None] Created volume successfully. Jul 07 10:47:50 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 Jul 07 10:47:50 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:51 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-d8945ad6-4bbc-4187-9cf8-e580bd89ec57 req-6e3c1280-3b55-4f11-b32b-416b3212a436 tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4" returned: 0 in 0.874s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-d8945ad6-4bbc-4187-9cf8-e580bd89ec57 req-6e3c1280-3b55-4f11-b32b-416b3212a436 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.337s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Creating offline snapshot 15275c1a-4b3b-4657-b975-95025c54d757 of volume e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e29eb2-4e1b-49ba-9641-fcbb2544a843]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-d8945ad6-4bbc-4187-9cf8-e580bd89ec57 req-6e3c1280-3b55-4f11-b32b-416b3212a436 tempest-TestServerVolumeAttachmentScenario-742092418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8226a452-11eb-4d82-8990-7af5c3695833', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:47:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-d8945ad6-4bbc-4187-9cf8-e580bd89ec57 req-6e3c1280-3b55-4f11-b32b-416b3212a436 tempest-TestServerVolumeAttachmentScenario-742092418 None] attachment_update completed successfully. Jul 07 10:47:51 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 Jul 07 10:47:51 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:52 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986" returned: 0 in 0.853s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:52 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 1G Jul 07 10:47:52 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:53 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 1G" returned: 0 in 0.934s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:53 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 Jul 07 10:47:53 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:53 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757" returned: 0 in 0.691s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:53 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 is being set with open permissions: ugo+rw Jul 07 10:47:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:53 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 Jul 07 10:47:53 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:54 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757" returned: 0 in 0.664s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:54 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.info Jul 07 10:47:54 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:55 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.info" returned: 0 in 0.647s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:55 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.info is being set with open permissions: ugo+rw Jul 07 10:47:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:55 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.info Jul 07 10:47:55 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:56 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.info" returned: 0 in 0.807s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.728s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9ce74892-bff4-4d98-8803-49158a44c280 tempest-VolumesSnapshotTestJSON-1354762993 None] Create snapshot completed successfully Jul 07 10:47:56 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:47:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (bdc086fe-feeb-46a5-99d2-ec284073a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:47:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4055973e-515b-458b-b4e9-df235ca21ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4055973e-515b-458b-b4e9-df235ca21ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-873829042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3669c6-959d-4a02-97f9-9db3cedebba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d449878dd48a6b30f37a1350fe5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=15275c1a-4b3b-4657-b975-95025c54d757,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:47:57Z,use_quota=True,user_id='faa3153d1d2144e88b9994657ebbd761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421a480a-b86b-485b-b464-eade4b94eb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421a480a-b86b-485b-b464-eade4b94eb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7c752f-fd13-47c9-a169-ddc32a9cf162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7c752f-fd13-47c9-a169-ddc32a9cf162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a3669c6-959d-4a02-97f9-9db3cedebba7', 'volume_name': 'volume-1a3669c6-959d-4a02-97f9-9db3cedebba7', 'volume_size': 1, 'snapshot_id': '15275c1a-4b3b-4657-b975-95025c54d757'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b658497c-6c04-4dac-961c-a4c73a0704a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b658497c-6c04-4dac-961c-a4c73a0704a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e31448b-5e23-4d93-be9f-ce177b167e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:47:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Volume 1a3669c6-959d-4a02-97f9-9db3cedebba7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a3669c6-959d-4a02-97f9-9db3cedebba7', 'volume_size': 1, 'snapshot_id': '15275c1a-4b3b-4657-b975-95025c54d757'} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-15275c1a-4b3b-4657-b975-95025c54d757-1a3669c6-959d-4a02-97f9-9db3cedebba7" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-15275c1a-4b3b-4657-b975-95025c54d757-1a3669c6-959d-4a02-97f9-9db3cedebba7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Creating volume 1a3669c6-959d-4a02-97f9-9db3cedebba7 from snapshot 15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-1a3669c6-959d-4a02-97f9-9db3cedebba7" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1a3669c6-959d-4a02-97f9-9db3cedebba7" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] snapshot: 15275c1a-4b3b-4657-b975-95025c54d757, volume: 1a3669c6-959d-4a02-97f9-9db3cedebba7, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[890b7d06-c51c-4c71-87fa-fa8d546df197]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:57 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 Jul 07 10:47:57 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-f5b675e4-5ab9-4706-98f2-23633b2d2917 req-7e5457a7-e4ef-412c-94c0-c5dff6a599a4 tempest-TestServerVolumeAttachmentScenario-742092418 None] Terminate volume connection completed successfully. Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-f5b675e4-5ab9-4706-98f2-23633b2d2917 req-7e5457a7-e4ef-412c-94c0-c5dff6a599a4 tempest-TestServerVolumeAttachmentScenario-742092418 None] Deleting attachment 8226a452-11eb-4d82-8990-7af5c3695833. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:47:57 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757" returned: 0 in 0.808s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c3b4a-63a3-46fb-b882-16fed04e1876]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:47:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:58 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 Jul 07 10:47:58 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:47:58 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 07 10:47:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986" returned: 0 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:47:58 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:47:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:47:58 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 Jul 07 10:47:58 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f56ecc9-7ed4-4016-bcd5-05910a2b6b70 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6" by "attach_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f56ecc9-7ed4-4016-bcd5-05910a2b6b70 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6" acquired by "attach_volume" :: waited 0.056s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5f56ecc9-7ed4-4016-bcd5-05910a2b6b70 tempest-VolumesActionsTest-1049792614 None] Attaching volume b911865f-67ac-4446-9597-42521d49e7d6 to instance c2062bc3-d722-4f1a-a83f-bd145eda8a9c at mountpoint /dev/vdb on host None. Jul 07 10:48:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5f56ecc9-7ed4-4016-bcd5-05910a2b6b70 tempest-VolumesActionsTest-1049792614 None] Attach volume completed successfully. Jul 07 10:48:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5f56ecc9-7ed4-4016-bcd5-05910a2b6b70 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6" released by "attach_volume" :: held 0.282s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:02 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-f8f95164-74fa-4eda-ae60-ae1f858bf603 req-d2a38630-ea8e-4acc-be73-df07f09f1da6 tempest-TestServerVolumeAttachmentScenario-742092418 None] Terminate volume connection completed successfully. Jul 07 10:48:02 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-f8f95164-74fa-4eda-ae60-ae1f858bf603 req-d2a38630-ea8e-4acc-be73-df07f09f1da6 tempest-TestServerVolumeAttachmentScenario-742092418 None] Deleting attachment 0e8a225f-dd2f-4dbb-865f-2975a9e66536. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:48:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7cf6567e-7e92-42e3-9813-7a7b3dfbe848 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-detach_volume" by "detach_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7cf6567e-7e92-42e3-9813-7a7b3dfbe848 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:02 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7cf6567e-7e92-42e3-9813-7a7b3dfbe848 tempest-VolumesActionsTest-1049792614 None] Detaching volume b911865f-67ac-4446-9597-42521d49e7d6 from instance c2062bc3-d722-4f1a-a83f-bd145eda8a9c. Jul 07 10:48:02 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7cf6567e-7e92-42e3-9813-7a7b3dfbe848 tempest-VolumesActionsTest-1049792614 None] Detach volume completed successfully. Jul 07 10:48:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-7cf6567e-7e92-42e3-9813-7a7b3dfbe848 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-detach_volume" released by "detach_volume" :: held 0.192s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:06 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7" returned: 0 in 7.256s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:06 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6b737-dba3-416f-9fdd-baa06ed8b37f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:06 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 Jul 07 10:48:06 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:07 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986" returned: 0 in 1.052s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:48:07 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Converted 1024.00 MB image at 141.10 MB/s Jul 07 10:48:07 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 is being set with open permissions: ugo+rw Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:07 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 Jul 07 10:48:07 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:07 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7" returned: 0 in 0.706s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1a3669c6-959d-4a02-97f9-9db3cedebba7" released by "_copy_volume_from_snapshot" :: held 10.750s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-15275c1a-4b3b-4657-b975-95025c54d757-1a3669c6-959d-4a02-97f9-9db3cedebba7" released by "_create_volume_from_snapshot" :: held 10.780s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.795s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e31448b-5e23-4d93-be9f-ce177b167e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3669c6-959d-4a02-97f9-9db3cedebba7', 'volume_size': 1, 'snapshot_id': '15275c1a-4b3b-4657-b975-95025c54d757'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4059f26-f8cc-41fb-ae12-c3d0005363e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:48:07 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Volume volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 (1a3669c6-959d-4a02-97f9-9db3cedebba7): created successfully Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4059f26-f8cc-41fb-ae12-c3d0005363e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:48:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Flow 'volume_create_manager' (bdc086fe-feeb-46a5-99d2-ec284073a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:48:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4361f8bc-5061-4d06-89d3-5798a71aa126 tempest-VolumesSnapshotTestJSON-1354762993 None] Created volume successfully. Jul 07 10:48:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-1a3669c6-959d-4a02-97f9-9db3cedebba7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-1a3669c6-959d-4a02-97f9-9db3cedebba7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-1a3669c6-959d-4a02-97f9-9db3cedebba7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1a3669c6-959d-4a02-97f9-9db3cedebba7" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f0b2d3-c75e-4071-9018-780a2505f1a9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:09 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 Jul 07 10:48:09 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:09 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7" returned: 0 in 0.824s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:09 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7 Jul 07 10:48:09 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:10 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1a3669c6-959d-4a02-97f9-9db3cedebba7" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-1a3669c6-959d-4a02-97f9-9db3cedebba7" released by "delete_volume" :: held 1.510s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['5c4ff5d6-6ad1-44ac-a0e7-5062a5648833', '11974554-db44-4192-ae09-404cab1726f0', 'dd7c6176-301e-4c8c-acc0-dda70c6779e9', '8f60cac7-4a23-4f33-9998-63accca39560'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:10 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:48:10 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-15275c1a-4b3b-4657-b975-95025c54d757-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-15275c1a-4b3b-4657-b975-95025c54d757-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-e04a83dc-8b3d-4844-a06a-0160ec1e5986" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-e04a83dc-8b3d-4844-a06a-0160ec1e5986" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-15275c1a-4b3b-4657-b975-95025c54d757" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-15275c1a-4b3b-4657-b975-95025c54d757" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Deleting offline snapshot 15275c1a-4b3b-4657-b975-95025c54d757 of volume e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] snapshot_file for this snap is: volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[56349c17-3820-4b9a-9267-a32be55ba279]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:11 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.697s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:48:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Deleted volume successfully. Jul 07 10:48:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-782a5eca-66ec-4147-9181-2f8a7a8b1ed6 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-1a3669c6-959d-4a02-97f9-9db3cedebba7-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:11 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 Jul 07 10:48:11 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:12 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a1bdb7-3023-4610-96b4-fc96c93f9d1c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:12 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 Jul 07 10:48:12 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4895b8-684c-4ecb-b7a6-c6a48d86c064]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:12 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:48:12 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:12 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986" returned: 0 in 0.849s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:12 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 Jul 07 10:48:12 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "cinder-7b4c65f0-f0a2-40c4-9cc7-415be90830e4-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-7b4c65f0-f0a2-40c4-9cc7-415be90830e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "cinder-quobyte-7b4c65f0-f0a2-40c4-9cc7-415be90830e4" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-quobyte-7b4c65f0-f0a2-40c4-9cc7-415be90830e4" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[07152e51-a45e-446f-8ee1-ec3c70c6eadb]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:13 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 Jul 07 10:48:13 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:13 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 0.834s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef51e5-dd92-4ad7-a26c-752127d23704]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:13 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:48:13 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:13 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757" returned: 0 in 0.829s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:13 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757 Jul 07 10:48:13 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:14 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4" returned: 0 in 0.907s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:14 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4 Jul 07 10:48:14 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:14 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 0.824s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.3f14002a-4c6e-46ab-8b17-f2a46d4adadf7e009zpt.img {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:14 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.3f14002a-4c6e-46ab-8b17-f2a46d4adadf7e009zpt.img Jul 07 10:48:14 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:14 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986.15275c1a-4b3b-4657-b975-95025c54d757" returned: 0 in 0.751s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-15275c1a-4b3b-4657-b975-95025c54d757" released by "_delete_snapshot" :: held 3.400s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-e04a83dc-8b3d-4844-a06a-0160ec1e5986" released by "delete_snapshot" :: held 3.426s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['ddce4d84-cb5b-402e-814a-a8bc06098ed1', '7b7c3525-67e7-4ded-ac3f-d182816f02e5', '375615bd-c387-4037-877b-facb4fb4bcbe', '7066a82b-62b1-4df7-a910-309daf270387'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:48:14 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-7b4c65f0-f0a2-40c4-9cc7-415be90830e4" returned: 0 in 0.673s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-quobyte-7b4c65f0-f0a2-40c4-9cc7-415be90830e4" released by "delete_volume" :: held 1.628s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Delete snapshot completed successfully. Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6ef37aee-df53-4e41-baab-a3bccd86138c tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-15275c1a-4b3b-4657-b975-95025c54d757-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Created reservations ['8a1e715e-3bd5-470a-8bb0-285a24af2750', '49dd0e13-3e4e-48b6-9e5f-b0b35e907115', '37fcaad9-4954-489b-bfff-29b1387c507d', '4db37035-a021-4b7f-b2c0-9b9e4a2fe480'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:15 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:48:15 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "cinder-96cc5176-8818-4173-9a8f-36ffb84bcbb9-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-96cc5176-8818-4173-9a8f-36ffb84bcbb9-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "cinder-quobyte-96cc5176-8818-4173-9a8f-36ffb84bcbb9" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-e04a83dc-8b3d-4844-a06a-0160ec1e5986-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-quobyte-96cc5176-8818-4173-9a8f-36ffb84bcbb9" acquired by "delete_volume" :: waited 0.063s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-e04a83dc-8b3d-4844-a06a-0160ec1e5986-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e8703-5bc1-4bcb-883b-821fc0804df8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-e04a83dc-8b3d-4844-a06a-0160ec1e5986" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-e04a83dc-8b3d-4844-a06a-0160ec1e5986" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6477dc-f54c-451a-8a61-cc4cc187fc71]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:16 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 Jul 07 10:48:16 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:16 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 Jul 07 10:48:16 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:16 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.634s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:16 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:48:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Deleted volume successfully. Jul 07 10:48:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5e3de721-fa29-4eaf-81d2-f27355cb8b3e tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-7b4c65f0-f0a2-40c4-9cc7-415be90830e4-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:17 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986" returned: 0 in 1.693s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:17 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986 Jul 07 10:48:17 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:18 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9" returned: 0 in 2.111s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:18 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9 Jul 07 10:48:18 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:19 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e04a83dc-8b3d-4844-a06a-0160ec1e5986" returned: 0 in 1.335s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-e04a83dc-8b3d-4844-a06a-0160ec1e5986" released by "delete_volume" :: held 3.157s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['3b47f0f9-97b6-4590-8dac-4f78dd8b68ef', '19283411-0c15-439a-b125-2c316c29b1ad', 'd6eb8ac7-d00b-443a-a6d7-3a795b88c0b7', '245c4d3a-26a0-490c-9db7-14726a1e0716'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:19 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:48:19 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:19 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-96cc5176-8818-4173-9a8f-36ffb84bcbb9" returned: 0 in 1.634s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-quobyte-96cc5176-8818-4173-9a8f-36ffb84bcbb9" released by "delete_volume" :: held 3.858s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:19 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.3f14002a-4c6e-46ab-8b17-f2a46d4adadf7e009zpt.img" returned: 0 in 5.579s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9795a8-1ced-4010-8227-171012e87e05]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Created reservations ['4babd0c2-464d-4b8d-84b7-fbb89655f7b8', 'dcd69ebd-6491-4834-a42a-99a74464ad06', '35648826-8681-4152-981f-4e87bf93a29f', '617852f8-992b-4b41-9912-b1ff785da3aa'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:19 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:48:19 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:19 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:48:19 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:20 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.670s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:48:20 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Deleted volume successfully. Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-76e64958-90ff-42d9-90cb-37d2381b4cac tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-e04a83dc-8b3d-4844-a06a-0160ec1e5986-delete_volume" released by "delete_volume" :: held 4.388s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:20 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.660s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:48:20 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Deleted volume successfully. Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1cbef79f-23fb-48d8-89d2-ab4f8e2727d5 tempest-TestServerVolumeAttachmentScenario-742092418 None] Lock "cinder-96cc5176-8818-4173-9a8f-36ffb84bcbb9-delete_volume" released by "delete_volume" :: held 4.846s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-abbf3e49-9f63-436a-bce1-56ab32e40d11-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-abbf3e49-9f63-436a-bce1-56ab32e40d11-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "cinder-quobyte-abbf3e49-9f63-436a-bce1-56ab32e40d11" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-abbf3e49-9f63-436a-bce1-56ab32e40d11" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[85647273-49bc-46b1-b657-5ab805c74227]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:20 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 1.097s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.3f14002a-4c6e-46ab-8b17-f2a46d4adadf7e009zpt.img {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:48:20 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Converted 1024.00 MB image at 183.50 MB/s Jul 07 10:48:20 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] 3f14002a-4c6e-46ab-8b17-f2a46d4adadf was raw, no need to convert to raw {{(pid=87208) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 10:48:20 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 Jul 07 10:48:20 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:21 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11" returned: 0 in 0.862s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:21 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11 Jul 07 10:48:21 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:22 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-abbf3e49-9f63-436a-bce1-56ab32e40d11" returned: 0 in 0.732s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-quobyte-abbf3e49-9f63-436a-bce1-56ab32e40d11" released by "delete_volume" :: held 1.660s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Created reservations ['e3c19f3c-7ae8-41f4-a8c9-c614ebb38aa1', 'e69b5be3-bfda-4c73-8a9b-ff208712025d', 'b682acc8-b418-43d9-bf9e-8db1234930ea', '4bf17e85-4275-4d03-ad33-a32ce7e1263f'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:22 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:48:22 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:23 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.932s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:48:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Deleted volume successfully. Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2f696f69-ab53-4a91-b4d6-99671cd0f791 tempest-VolumesSnapshotTestJSON-1354762993 None] Lock "cinder-abbf3e49-9f63-436a-bce1-56ab32e40d11-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:23 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:48:23 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:24 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.981s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:48:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:48:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:48:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:48:32 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=79,cinder:SELECT=71,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:48:33 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:DELETE=5,cinder:SELECT=78,cinder:UPDATE=83,cinder:INSERT=22 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:48:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.786s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:48:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Uploaded volume to glance image-id: 3f14002a-4c6e-46ab-8b17-f2a46d4adadf. {{(pid=87208) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 10:48:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-942499bc-431c-45f0-97a9-bb38d7455ef8 tempest-VolumesActionsTest-1049792614 None] Copy volume to image completed successfully. Jul 07 10:48:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:48:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:48:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3f3c22-3d83-417b-a7b4-d68d861f84ce]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:47 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:48:47 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:48 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 1.033s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:48 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a97b48-468e-479a-8650-d5fdee466a40]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:48 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:48:48 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:48 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 0.926s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:48 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img Jul 07 10:48:48 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:54 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img" returned: 0 in 5.601s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:54 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[17363a8b-5e59-4ed3-9ab8-14fe6da60006]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:54 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:48:54 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:55 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:48:55 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 1.142s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:55 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:48:55 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Converted 1024.00 MB image at 182.77 MB/s Jul 07 10:48:55 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] a62090c4-ede3-4ae3-838e-81b4296d873a was raw, converting to qcow2 {{(pid=87208) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 10:48:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81300de-9ee1-40be-b697-90bc724f8dea]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:55 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img Jul 07 10:48:55 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:56 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:56 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img Jul 07 10:48:56 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:56 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:48:57 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img" returned: 1 in 0.844s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:48:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img /opt/stack/data/cinder/conversion/vol_upload_q7oqxiv9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:57 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img /opt/stack/data/cinder/conversion/vol_upload_q7oqxiv9 Jul 07 10:48:57 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:58 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img /opt/stack/data/cinder/conversion/vol_upload_q7oqxiv9" returned: 0 in 0.780s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:48:58 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Image conversion details: src /opt/stack/data/cinder/conversion/b911865f-67ac-4446-9597-42521d49e7d6.temp_image.a62090c4-ede3-4ae3-838e-81b4296d873a9oe9v24m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_q7oqxiv9 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:48:58 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 10:48:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac397261-4c36-4d7d-a5ec-aaeaf5b2fc6e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:48:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q7oqxiv9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:48:58 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q7oqxiv9 Jul 07 10:48:58 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:48:58 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 07 10:48:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q7oqxiv9" returned: 0 in 0.812s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.757s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Uploaded volume to glance image-id: a62090c4-ede3-4ae3-838e-81b4296d873a. {{(pid=87208) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 10:49:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-914da4a9-db89-4a99-bc61-4f5541f9a15a tempest-VolumesActionsTest-1049792614 None] Copy volume to image completed successfully. Jul 07 10:49:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:49:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:49:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "cinder-quobyte-b911865f-67ac-4446-9597-42521d49e7d6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:49:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-quobyte-b911865f-67ac-4446-9597-42521d49e7d6" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:49:01 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7131dd30-15e5-4408-9a26-4af0180086f5]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:01 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:49:01 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:02 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 1.014s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:02 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6 Jul 07 10:49:02 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:03 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b911865f-67ac-4446-9597-42521d49e7d6" returned: 0 in 0.757s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-quobyte-b911865f-67ac-4446-9597-42521d49e7d6" released by "delete_volume" :: held 1.855s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Created reservations ['906399e3-a15f-457a-8b1a-7934eef7fdab', 'e9df6696-ce77-4117-aa35-e1688abcde79', '8c9eb4b6-a140-4a1a-ab34-da7e342701aa', '0d84a36d-3686-4768-aa79-2399a46e5d29'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:03 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:49:03 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:04 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.718s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:04 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:49:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Deleted volume successfully. Jul 07 10:49:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d346fbfa-b5d1-491c-bcd7-ff22f39382a6 tempest-VolumesActionsTest-1049792614 None] Lock "cinder-b911865f-67ac-4446-9597-42521d49e7d6-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Flow 'volume_create_manager' (89f9bc45-833b-4f30-a887-36d2ae46b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6b1232-fd42-418c-8fb1-5acb2752aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6b1232-fd42-418c-8fb1-5acb2752aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1750987612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9759b1-c515-4c65-aa25-50dec161042c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502521739cab48aba941128d77f0ecd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:49:07Z,use_quota=True,user_id='2983a08ca2214020bbe6a5bde3a58b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5722ccda-d5fe-479d-9f5f-0125b9ddff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5722ccda-d5fe-479d-9f5f-0125b9ddff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a23a62f-dd99-4865-b636-5004c3318245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a23a62f-dd99-4865-b636-5004c3318245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9759b1-c515-4c65-aa25-50dec161042c', 'volume_name': 'volume-de9759b1-c515-4c65-aa25-50dec161042c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b571a80f-efac-45ac-8ee6-5adcc13d3dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b571a80f-efac-45ac-8ee6-5adcc13d3dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbc9d68-1b86-4241-b199-45dfe9e81a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:06 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Volume de9759b1-c515-4c65-aa25-50dec161042c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9759b1-c515-4c65-aa25-50dec161042c', 'volume_size': 1} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1750987612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9759b1-c515-4c65-aa25-50dec161042c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502521739cab48aba941128d77f0ecd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:49:07Z,use_quota=True,user_id='2983a08ca2214020bbe6a5bde3a58b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Creating volume de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:49:06 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:49:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:06 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c 1073741824 Jul 07 10:49:06 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:07 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c 1073741824" returned: 0 in 1.103s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:49:07 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:49:07 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Flow 'volume_create_manager' (7491a0f3-8605-494e-96fc-0b8983bdc0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c269d86-fa53-4a44-bda1-9f8dd3bf7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c269d86-fa53-4a44-bda1-9f8dd3bf7d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-439682975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedcddc3-4e06-444c-b793-067db97c36a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edd29c5687c426bbb5511371065a1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:49:08Z,use_quota=True,user_id='77828f1db9634013be08c55cd2b41ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3f3af-b92c-48a9-92ac-1c1d8a27705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3f3af-b92c-48a9-92ac-1c1d8a27705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebd3247-d417-415a-ba05-6ff447fddcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:07 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebd3247-d417-415a-ba05-6ff447fddcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eedcddc3-4e06-444c-b793-067db97c36a5', 'volume_name': 'volume-eedcddc3-4e06-444c-b793-067db97c36a5', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45246bc-ad36-4fb3-b542-2fa7314525f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45246bc-ad36-4fb3-b542-2fa7314525f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd977fb-64aa-4240-8dfa-33997dbc646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:08 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Volume eedcddc3-4e06-444c-b793-067db97c36a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eedcddc3-4e06-444c-b793-067db97c36a5', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Trying to clone eedcddc3-4e06-444c-b793-067db97c36a5 from image d50a09c8-834c-44f1-b638-afb2a382f8e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:49:08 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 0.855s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbc9d68-1b86-4241-b199-45dfe9e81a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9759b1-c515-4c65-aa25-50dec161042c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415f8ec2-2d58-43eb-b1f9-b0beaccd43f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:08 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Volume volume-de9759b1-c515-4c65-aa25-50dec161042c (de9759b1-c515-4c65-aa25-50dec161042c): created successfully Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415f8ec2-2d58-43eb-b1f9-b0beaccd43f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Flow 'volume_create_manager' (89f9bc45-833b-4f30-a887-36d2ae46b130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:49:08 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1e9545d4-efec-45c2-a9c4-9cfddb0f6319 tempest-TestStampPattern-1879481931 None] Created volume successfully. Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:49:08 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Image download 20.69 MB at 20.69 MB/s Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caa3b34-9915-43da-b088-3a3e2a1ba7d0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:09 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD Jul 07 10:49:09 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:09 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:09 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 is fetched for user 77828f1db9634013be08c55cd2b41ac6. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:49:09 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[76810b2b-496c-4477-b602-e36c569a3a18]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:10 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD Jul 07 10:49:10 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:10 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-439682975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedcddc3-4e06-444c-b793-067db97c36a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edd29c5687c426bbb5511371065a1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:49:08Z,use_quota=True,user_id='77828f1db9634013be08c55cd2b41ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Creating volume eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:49:10 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:49:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:10 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 1073741824 Jul 07 10:49:10 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:11 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 1073741824" returned: 0 in 0.956s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:11 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:49:11 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Flow 'volume_create_manager' (1a9cee02-6b62-407b-9276-38266f58d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8823b05-af48-4765-92ee-b40c3bea01c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8823b05-af48-4765-92ee-b40c3bea01c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1843367237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a1fce7-2428-4e06-b732-af5e587078da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ab5821ded54b5ca5557a4fc5317181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:49:12Z,use_quota=True,user_id='e874e9c4115f467887f501d380ea0ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185a6f29-6e76-46ff-9203-8fa7ec531f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185a6f29-6e76-46ff-9203-8fa7ec531f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317cf66e-d98b-4d89-9ad6-f5e17b078ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317cf66e-d98b-4d89-9ad6-f5e17b078ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a1fce7-2428-4e06-b732-af5e587078da', 'volume_name': 'volume-11a1fce7-2428-4e06-b732-af5e587078da', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79664884-20ba-44e5-883c-d168f372e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79664884-20ba-44e5-883c-d168f372e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22e34d8-6111-48c0-b669-8a60de6cb592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Volume 11a1fce7-2428-4e06-b732-af5e587078da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a1fce7-2428-4e06-b732-af5e587078da', 'volume_size': 1} Jul 07 10:49:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:12 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 0 in 0.657s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1843367237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a1fce7-2428-4e06-b732-af5e587078da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ab5821ded54b5ca5557a4fc5317181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:49:12Z,use_quota=True,user_id='e874e9c4115f467887f501d380ea0ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Creating volume 11a1fce7-2428-4e06-b732-af5e587078da {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:49:12 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:12 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da 1073741824 Jul 07 10:49:12 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Attempting download of d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume eedcddc3-4e06-444c-b793-067db97c36a5. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0293c3-6569-4de7-b0c9-96a3131e6296]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_jywx59_5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:12 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_jywx59_5 Jul 07 10:49:12 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:13 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_jywx59_5" returned: 0 in 0.757s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_jywx59_5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:13 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da 1073741824" returned: 0 in 0.853s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:13 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da Jul 07 10:49:13 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:13 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_jywx59_5 Jul 07 10:49:13 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:14 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da" returned: 0 in 0.796s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22e34d8-6111-48c0-b669-8a60de6cb592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a1fce7-2428-4e06-b732-af5e587078da', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af704a0-1bbf-47c7-8279-6906b76040cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:14 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Volume volume-11a1fce7-2428-4e06-b732-af5e587078da (11a1fce7-2428-4e06-b732-af5e587078da): created successfully Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af704a0-1bbf-47c7-8279-6906b76040cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Flow 'volume_create_manager' (1a9cee02-6b62-407b-9276-38266f58d52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:49:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-915e7ec0-0a23-434e-9bc7-bf1cb9e55f47 tempest-VolumesNegativeTest-1303605676 None] Created volume successfully. Jul 07 10:49:14 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_jywx59_5" returned: 1 in 0.985s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50a09c8-834c-44f1-b638-afb2a382f8e6_jywx59_5' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f124685-a087-462b-9396-cf7d35f76e27]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:14 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD Jul 07 10:49:14 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:15 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:15 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] d50a09c8-834c-44f1-b638-afb2a382f8e6 was qcow2, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:49:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:15 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:49:15 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:17 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 0 in 2.278s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:17 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d50a09c8-834c-44f1-b638-afb2a382f8e6_sov51ubhdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:49:17 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Converted 112.00 MB image at 49.13 MB/s Jul 07 10:49:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:17 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 1G Jul 07 10:49:17 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:18 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 1G" returned: 0 in 0.698s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0086eb8-8387-4744-880f-f012639054be]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:18 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:49:18 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:18 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 0 in 0.773s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:18 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:49:18 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:19 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 1 in 1.113s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:49:19 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Downloaded image d50a09c8-834c-44f1-b638-afb2a382f8e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}])) to volume eedcddc3-4e06-444c-b793-067db97c36a5 successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:49:19 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Temporary image d50a09c8-834c-44f1-b638-afb2a382f8e6 for user 77828f1db9634013be08c55cd2b41ac6 is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:49:19 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Marking volume eedcddc3-4e06-444c-b793-067db97c36a5 as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:49:20 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Copying metadata from image d50a09c8-834c-44f1-b638-afb2a382f8e6 to eedcddc3-4e06-444c-b793-067db97c36a5. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:49:20 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Creating volume glance metadata for volume eedcddc3-4e06-444c-b793-067db97c36a5 backed by image d50a09c8-834c-44f1-b638-afb2a382f8e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:49:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd977fb-64aa-4240-8dfa-33997dbc646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedcddc3-4e06-444c-b793-067db97c36a5', 'volume_size': 1, 'image_id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50a09c8-834c-44f1-b638-afb2a382f8e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf145244cfe64e418aa442163ee215e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50a09c8-834c-44f1-b638-afb2a382f8e6', 'created_at': datetime.datetime(2026, 7, 7, 8, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 27, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50a09c8-834c-44f1-b638-afb2a382f8e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ac1f5b-a7fd-4505-9930-7c5319d8da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:49:20 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Volume volume-eedcddc3-4e06-444c-b793-067db97c36a5 (eedcddc3-4e06-444c-b793-067db97c36a5): created successfully Jul 07 10:49:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ac1f5b-a7fd-4505-9930-7c5319d8da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:49:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Flow 'volume_create_manager' (7491a0f3-8605-494e-96fc-0b8983bdc0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:49:20 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-32f30344-9208-4183-91ac-fba80072b272 tempest-TestShelveInstance-1892212415 None] Created volume successfully. Jul 07 10:49:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:49:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:49:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:49:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:23 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:49:23 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:24 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.953s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:49:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:49:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:49:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:49:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:28 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8216cee5-61a3-46ce-b393-9534a5c8371b]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:28 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:49:28 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:29 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 0 in 1.211s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:29 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:49:29 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:30 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:49:31 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 1 in 1.480s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:49:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.740s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-eedcddc3-4e06-444c-b793-067db97c36a5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a42c6eed-7caa-48cb-85b4-9379696d6559', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:49:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-a251ac64-0cca-4a9d-b9c0-a51265cba1e6 req-334083b3-7d50-4f79-91fa-49ecea069d8b tempest-TestShelveInstance-1892212415 None] attachment_update completed successfully. Jul 07 10:49:41 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:49:41 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=19,cinder:SELECT=25,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:49:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Acquiring lock "cinder-11a1fce7-2428-4e06-b732-af5e587078da-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:49:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Lock "cinder-11a1fce7-2428-4e06-b732-af5e587078da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:49:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Acquiring lock "cinder-quobyte-11a1fce7-2428-4e06-b732-af5e587078da" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:49:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Lock "cinder-quobyte-11a1fce7-2428-4e06-b732-af5e587078da" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:49:49 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf260c-aa90-496e-8643-3a899b2f8397]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:49 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da Jul 07 10:49:49 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:50 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da" returned: 0 in 0.791s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:50 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da Jul 07 10:49:50 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7a1ba282-17c3-4713-992e-8d22bce00c65 req-66787a76-7706-4006-bfbc-ecb4392f3e48 tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7a1ba282-17c3-4713-992e-8d22bce00c65 req-66787a76-7706-4006-bfbc-ecb4392f3e48 tempest-TestStampPattern-1879481931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59b2073-fd2f-4eac-9220-137c18380acb]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7a1ba282-17c3-4713-992e-8d22bce00c65 req-66787a76-7706-4006-bfbc-ecb4392f3e48 tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:50 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:49:50 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:50 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-11a1fce7-2428-4e06-b732-af5e587078da" returned: 0 in 0.706s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Lock "cinder-quobyte-11a1fce7-2428-4e06-b732-af5e587078da" released by "delete_volume" :: held 1.544s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:49:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Created reservations ['68ae3dc5-a47f-40e2-bcaa-118f693afbf1', 'a5a77843-06a6-4543-a820-cdd723f30a5a', '74cd316d-d90d-4086-9e14-37afaae0d079', 'e78f0e5f-42ef-4078-bdcd-e9c21841e0eb'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:49:51 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:49:51 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:49:51 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7a1ba282-17c3-4713-992e-8d22bce00c65 req-66787a76-7706-4006-bfbc-ecb4392f3e48 tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 0.804s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7a1ba282-17c3-4713-992e-8d22bce00c65 req-66787a76-7706-4006-bfbc-ecb4392f3e48 tempest-TestStampPattern-1879481931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-7a1ba282-17c3-4713-992e-8d22bce00c65 req-66787a76-7706-4006-bfbc-ecb4392f3e48 tempest-TestStampPattern-1879481931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-de9759b1-c515-4c65-aa25-50dec161042c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ccfd0f6-1c41-44a6-8e96-b3e261ee829d', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:49:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-7a1ba282-17c3-4713-992e-8d22bce00c65 req-66787a76-7706-4006-bfbc-ecb4392f3e48 tempest-TestStampPattern-1879481931 None] attachment_update completed successfully. Jul 07 10:49:51 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.753s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:49:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Deleted volume successfully. Jul 07 10:49:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9cdeea81-9f59-40e4-8226-ce514a916669 tempest-VolumesNegativeTest-1303605676 None] Lock "cinder-11a1fce7-2428-4e06-b732-af5e587078da-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:49:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-02bda17d-127a-4b9a-9861-38401d3e8d29 req-9d563ad1-b8d4-47f3-bc1b-addc47c4b1dc tempest-TestStampPattern-1879481931 None] Terminate volume connection completed successfully. Jul 07 10:49:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-02bda17d-127a-4b9a-9861-38401d3e8d29 req-9d563ad1-b8d4-47f3-bc1b-addc47c4b1dc tempest-TestStampPattern-1879481931 None] Deleting attachment 9ccfd0f6-1c41-44a6-8e96-b3e261ee829d. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:50:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Creating offline snapshot 23346348-e980-45fb-9e60-7d980e1ea76a of volume de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:50:02 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f11e1-c8c7-4e74-8467-f7ae84a888d3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:02 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:50:02 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:03 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 1.043s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:03 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a 1G Jul 07 10:50:03 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:04 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a 1G" returned: 0 in 0.852s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9759b1-c515-4c65-aa25-50dec161042c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:04 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9759b1-c515-4c65-aa25-50dec161042c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a Jul 07 10:50:04 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:04 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9759b1-c515-4c65-aa25-50dec161042c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a" returned: 0 in 0.773s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:05 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a is being set with open permissions: ugo+rw Jul 07 10:50:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:05 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a Jul 07 10:50:05 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:05 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:05 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.info Jul 07 10:50:05 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:06 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.info" returned: 0 in 0.762s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:06 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.info is being set with open permissions: ugo+rw Jul 07 10:50:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:06 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.info Jul 07 10:50:06 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:07 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.info" returned: 0 in 0.706s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.110s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-344abbb2-ac9d-4c3c-adf5-ecb716c96c5c tempest-TestStampPattern-1879481931 None] Create snapshot completed successfully Jul 07 10:50:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-c04be410-4ce7-45eb-8577-49f5fe7c9156 req-ec380ecd-2fc4-46af-9058-ce5b825cc659 tempest-TestShelveInstance-1892212415 None] Terminate volume connection completed successfully. Jul 07 10:50:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-c04be410-4ce7-45eb-8577-49f5fe7c9156 req-ec380ecd-2fc4-46af-9058-ce5b825cc659 tempest-TestShelveInstance-1892212415 None] Deleting attachment a42c6eed-7caa-48cb-85b4-9379696d6559. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:50:17 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Flow 'volume_create_manager' (34a62509-b16f-4e37-864c-3768d1d56a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8032afe-80b0-4db9-9b12-2826066ac317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8032afe-80b0-4db9-9b12-2826066ac317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-931591785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21731f72-0326-4cb1-bae1-84d70687a2e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502521739cab48aba941128d77f0ecd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=23346348-e980-45fb-9e60-7d980e1ea76a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:50:18Z,use_quota=True,user_id='2983a08ca2214020bbe6a5bde3a58b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19232172-0c1f-4086-a958-681251d7da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19232172-0c1f-4086-a958-681251d7da35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308d0360-e140-40cc-92fb-d2112ef68480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308d0360-e140-40cc-92fb-d2112ef68480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21731f72-0326-4cb1-bae1-84d70687a2e7', 'volume_name': 'volume-21731f72-0326-4cb1-bae1-84d70687a2e7', 'volume_size': 1, 'snapshot_id': '23346348-e980-45fb-9e60-7d980e1ea76a'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ec54ba-b407-4185-a27c-67d4172f042e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ec54ba-b407-4185-a27c-67d4172f042e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f33296a-92f1-4a85-9a97-5540f83c53e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:18 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Volume 21731f72-0326-4cb1-bae1-84d70687a2e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21731f72-0326-4cb1-bae1-84d70687a2e7', 'volume_size': 1, 'snapshot_id': '23346348-e980-45fb-9e60-7d980e1ea76a'} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-quobyte-23346348-e980-45fb-9e60-7d980e1ea76a-21731f72-0326-4cb1-bae1-84d70687a2e7" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-23346348-e980-45fb-9e60-7d980e1ea76a-21731f72-0326-4cb1-bae1-84d70687a2e7" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Creating volume 21731f72-0326-4cb1-bae1-84d70687a2e7 from snapshot 23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-quobyte-21731f72-0326-4cb1-bae1-84d70687a2e7" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-21731f72-0326-4cb1-bae1-84d70687a2e7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] snapshot: 23346348-e980-45fb-9e60-7d980e1ea76a, volume: 21731f72-0326-4cb1-bae1-84d70687a2e7, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[74232c50-16b6-484b-bef1-61699ec5999e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:18 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a Jul 07 10:50:18 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:19 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a" returned: 0 in 0.893s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de9759b1-c515-4c65-aa25-50dec161042c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3a46fb-de2f-4719-9f47-f867a93ee571]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:19 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:50:19 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:19 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 0.836s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:50:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:20 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 Jul 07 10:50:20 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:50:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:50:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:50:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:23 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:50:23 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Flow 'volume_create_manager' (eedecd93-7ad2-4002-9436-840df2e858c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3cb0c3-e6fd-4d88-b613-8c1b4e755d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3cb0c3-e6fd-4d88-b613-8c1b4e755d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1239997365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe4349c-599e-44eb-9eb0-e5658448b776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cb88ae20c5420ab49eaf95ffba84fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:50:24Z,use_quota=True,user_id='3f058689af8546df965a2532d641f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34027bc2-987d-4954-a2f9-21f80091cb76),volume_type_id=34027bc2-987d-4954-a2f9-21f80091cb76)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd67e13-3bf6-4573-963b-49f82b64d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd67e13-3bf6-4573-963b-49f82b64d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4d61e2-2bab-4c99-a9c9-e6aa7ab7da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4d61e2-2bab-4c99-a9c9-e6aa7ab7da96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe4349c-599e-44eb-9eb0-e5658448b776', 'volume_name': 'volume-5fe4349c-599e-44eb-9eb0-e5658448b776', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad72282-361b-4d0f-8887-84f6cfc8dc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad72282-361b-4d0f-8887-84f6cfc8dc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde2a028-ee5e-4624-841f-1f383daefbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume 5fe4349c-599e-44eb-9eb0-e5658448b776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe4349c-599e-44eb-9eb0-e5658448b776', 'volume_size': 1} Jul 07 10:50:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Flow 'volume_create_manager' (ad5a441b-858e-449e-bb32-14de9b71d026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f023aa2-06c7-4479-ad56-011fa3f7850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f023aa2-06c7-4479-ad56-011fa3f7850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1152833606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49322477-bdac-4eca-be98-c7841f18a2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cb88ae20c5420ab49eaf95ffba84fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:50:25Z,use_quota=True,user_id='3f058689af8546df965a2532d641f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24a90919-cb7a-4d98-8842-4fd2e1e20540),volume_type_id=24a90919-cb7a-4d98-8842-4fd2e1e20540)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1443f130-8b46-4516-9649-b95f805181b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1443f130-8b46-4516-9649-b95f805181b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b3b091-c10a-4b3b-9e36-f2a8f30afbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b3b091-c10a-4b3b-9e36-f2a8f30afbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49322477-bdac-4eca-be98-c7841f18a2dc', 'volume_name': 'volume-49322477-bdac-4eca-be98-c7841f18a2dc', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3079cfd4-70bf-4c91-9267-7327a04e0284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3079cfd4-70bf-4c91-9267-7327a04e0284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ce373b-236f-49a0-9ac3-33d26c6deb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:25 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume 49322477-bdac-4eca-be98-c7841f18a2dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49322477-bdac-4eca-be98-c7841f18a2dc', 'volume_size': 1} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:25 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 2.186s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:50:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:50:26 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7" returned: 0 in 6.999s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac9a63d-c9bc-41a9-b41e-4b7a1496d937]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:27 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:50:27 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Flow 'volume_create_manager' (134d6564-11be-4ba4-8b7c-f9b752e3f152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dcb554-ceb2-4d87-8fca-2c2cd329b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dcb554-ceb2-4d87-8fca-2c2cd329b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1339122245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cb88ae20c5420ab49eaf95ffba84fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:50:27Z,use_quota=True,user_id='3f058689af8546df965a2532d641f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59a393fe-ad32-4aa6-a976-8fca57e95816),volume_type_id=59a393fe-ad32-4aa6-a976-8fca57e95816)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4d5d0c-417a-4ae3-a7f7-6e3cda4f4b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4d5d0c-417a-4ae3-a7f7-6e3cda4f4b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308ecb2e-bc90-437a-8090-a5937f034c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308ecb2e-bc90-437a-8090-a5937f034c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6', 'volume_name': 'volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6', 'volume_size': 1, 'image_id': '3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--51340967', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7cb88ae20c5420ab49eaf95ffba84fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'created_at': datetime.datetime(2026, 7, 7, 8, 50, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a/file', 'properties': {}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1829cb08-fb06-407d-95d7-d79a3b6617b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1829cb08-fb06-407d-95d7-d79a3b6617b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673168ae-264e-40ed-84c8-c9e77de3aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:27 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6', 'volume_size': 1, 'image_id': '3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--51340967', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7cb88ae20c5420ab49eaf95ffba84fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'created_at': datetime.datetime(2026, 7, 7, 8, 50, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a/file', 'properties': {}}, 'image_service': } Jul 07 10:50:27 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Trying to clone 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 from image 3e5d452a-e7b2-489c-83d3-f6b09c82b86a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:50:28 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 1.311s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:28 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:50:28 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Converted 1024.00 MB image at 146.28 MB/s Jul 07 10:50:28 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 is being set with open permissions: ugo+rw Jul 07 10:50:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:28 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 Jul 07 10:50:28 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:29 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7" returned: 0 in 0.837s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-21731f72-0326-4cb1-bae1-84d70687a2e7" released by "_copy_volume_from_snapshot" :: held 11.010s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-23346348-e980-45fb-9e60-7d980e1ea76a-21731f72-0326-4cb1-bae1-84d70687a2e7" released by "_create_volume_from_snapshot" :: held 11.059s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.075s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.965s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f33296a-92f1-4a85-9a97-5540f83c53e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21731f72-0326-4cb1-bae1-84d70687a2e7', 'volume_size': 1, 'snapshot_id': '23346348-e980-45fb-9e60-7d980e1ea76a'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ef33d8-5c25-4c29-8166-4fb493304a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[981a759e-af69-47c0-96a5-b2b268043631]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:29 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Volume volume-21731f72-0326-4cb1-bae1-84d70687a2e7 (21731f72-0326-4cb1-bae1-84d70687a2e7): created successfully Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ef33d8-5c25-4c29-8166-4fb493304a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Flow 'volume_create_manager' (34a62509-b16f-4e37-864c-3768d1d56a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-99359522-1ca0-4108-b093-effe2854ac6d tempest-TestStampPattern-1879481931 None] Created volume successfully. Jul 07 10:50:29 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:50:29 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:30 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 0 in 0.858s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:30 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:50:30 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:30 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 1 in 0.850s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.784s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.096s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1239997365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe4349c-599e-44eb-9eb0-e5658448b776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cb88ae20c5420ab49eaf95ffba84fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:50:24Z,use_quota=True,user_id='3f058689af8546df965a2532d641f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34027bc2-987d-4954-a2f9-21f80091cb76),volume_type_id=34027bc2-987d-4954-a2f9-21f80091cb76)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Creating volume 5fe4349c-599e-44eb-9eb0-e5658448b776 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:50:30 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:50:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:31 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 1073741824 Jul 07 10:50:31 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-eedcddc3-4e06-444c-b793-067db97c36a5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1228c5f5-665a-4cd3-be14-c964bbca7dde', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:50:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-e1e1a49b-1bc1-47c0-bc94-69157d8f6b49 req-45f07ec2-98be-4f4b-b918-65302bb26805 tempest-TestShelveInstance-1892212415 None] attachment_update completed successfully. Jul 07 10:50:31 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD, size 20.69 MB, duration 4.03 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:50:31 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Image download 20.69 MB at 5.14 MB/s Jul 07 10:50:31 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb43edce-05a4-463c-8910-ed5d04c576cd]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:31 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD Jul 07 10:50:31 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:32 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 1073741824" returned: 0 in 1.050s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:32 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 Jul 07 10:50:32 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:32 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD" returned: 0 in 1.079s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Temporary image 3e5d452a-e7b2-489c-83d3-f6b09c82b86a is fetched for user 3f058689af8546df965a2532d641f3f8. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:50:32 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8393232d-eaaa-4bdf-a37d-a48fd7df2580]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776" returned: 0 in 0.797s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.258s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1152833606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49322477-bdac-4eca-be98-c7841f18a2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cb88ae20c5420ab49eaf95ffba84fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:50:25Z,use_quota=True,user_id='3f058689af8546df965a2532d641f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24a90919-cb7a-4d98-8842-4fd2e1e20540),volume_type_id=24a90919-cb7a-4d98-8842-4fd2e1e20540)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Creating volume 49322477-bdac-4eca-be98-c7841f18a2dc {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:50:32 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:32 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc 1073741824 Jul 07 10:50:32 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde2a028-ee5e-4624-841f-1f383daefbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe4349c-599e-44eb-9eb0-e5658448b776', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51df177c-c908-4e25-8e00-9b91e64c12b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:33 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume volume-5fe4349c-599e-44eb-9eb0-e5658448b776 (5fe4349c-599e-44eb-9eb0-e5658448b776): created successfully Jul 07 10:50:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51df177c-c908-4e25-8e00-9b91e64c12b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Flow 'volume_create_manager' (eedecd93-7ad2-4002-9436-840df2e858c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-84e9dc7a-37d1-48e2-af41-986cc2405c39 tempest-TestInstancesWithCinderVolumes-818461153 None] Created volume successfully. Jul 07 10:50:33 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD Jul 07 10:50:33 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:33 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:33 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc 1073741824" returned: 0 in 0.955s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:33 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc Jul 07 10:50:33 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:34 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc" returned: 0 in 0.717s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1339122245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cb88ae20c5420ab49eaf95ffba84fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:50:27Z,use_quota=True,user_id='3f058689af8546df965a2532d641f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59a393fe-ad32-4aa6-a976-8fca57e95816),volume_type_id=59a393fe-ad32-4aa6-a976-8fca57e95816)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Creating volume 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:50:34 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:34 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 1073741824 Jul 07 10:50:34 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ce373b-236f-49a0-9ac3-33d26c6deb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49322477-bdac-4eca-be98-c7841f18a2dc', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38df9b1e-9312-47ef-97ed-3dda8f838d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:34 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume volume-49322477-bdac-4eca-be98-c7841f18a2dc (49322477-bdac-4eca-be98-c7841f18a2dc): created successfully Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38df9b1e-9312-47ef-97ed-3dda8f838d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Flow 'volume_create_manager' (ad5a441b-858e-449e-bb32-14de9b71d026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:34 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8379c2e0-a851-4ac8-9d43-58084fe14846 tempest-TestInstancesWithCinderVolumes-818461153 None] Created volume successfully. Jul 07 10:50:35 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 1073741824" returned: 0 in 0.886s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:35 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:50:35 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:36 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 0 in 0.820s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:50:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:36 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Attempting download of 3e5d452a-e7b2-489c-83d3-f6b09c82b86a ((None, [{'url': 'file:///opt/stack/data/glance/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'metadata': {}}])) to volume 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:50:36 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a39361b-d12c-400e-b973-e3d8036d3724]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_ddb43to4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:36 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_ddb43to4 Jul 07 10:50:36 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:37 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_ddb43to4" returned: 0 in 1.029s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_ddb43to4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:37 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_ddb43to4 Jul 07 10:50:37 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:38 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_ddb43to4" returned: 1 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_ddb43to4' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:50:38 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e314b1-93e7-4a67-9a23-924a02e48f6e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:38 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD Jul 07 10:50:38 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:39 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:39 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] 3e5d452a-e7b2-489c-83d3-f6b09c82b86a was qcow2, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:50:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:39 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:50:39 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:41 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 0 in 2.374s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:41 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e5d452a-e7b2-489c-83d3-f6b09c82b86a_cna7stqudevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:50:41 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Converted 112.00 MB image at 47.08 MB/s Jul 07 10:50:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:41 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 1G Jul 07 10:50:41 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:42 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 1G" returned: 0 in 0.996s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee42e09-b426-4a05-9f98-baf202dae265]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:42 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:50:42 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:43 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 0 in 0.882s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:43 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:50:43 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:44 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 1 in 0.793s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Downloaded image 3e5d452a-e7b2-489c-83d3-f6b09c82b86a ((None, [{'url': 'file:///opt/stack/data/glance/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'metadata': {}}])) to volume 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Temporary image 3e5d452a-e7b2-489c-83d3-f6b09c82b86a for user 3f058689af8546df965a2532d641f3f8 is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Marking volume 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=33,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Copying metadata from image 3e5d452a-e7b2-489c-83d3-f6b09c82b86a to 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Creating volume glance metadata for volume 623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 backed by image 3e5d452a-e7b2-489c-83d3-f6b09c82b86a with: {'image_id': '3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'image_name': 'tempest-scenario-img--51340967', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=23,cinder:SELECT=31,cinder:INSERT=2,cinder:DELETE=4 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673168ae-264e-40ed-84c8-c9e77de3aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6', 'volume_size': 1, 'image_id': '3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--51340967', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7cb88ae20c5420ab49eaf95ffba84fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e5d452a-e7b2-489c-83d3-f6b09c82b86a', 'created_at': datetime.datetime(2026, 7, 7, 8, 50, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e5d452a-e7b2-489c-83d3-f6b09c82b86a/file', 'properties': {}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079d2e1-94eb-4508-8738-227c2797c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:50:44 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Volume volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 (623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6): created successfully Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079d2e1-94eb-4508-8738-227c2797c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:50:44 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Flow 'volume_create_manager' (134d6564-11be-4ba4-8b7c-f9b752e3f152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:50:44 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8105d791-3866-47c2-a6ac-65af43e44139 tempest-TestInstancesWithCinderVolumes-818461153 None] Created volume successfully. Jul 07 10:50:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:50:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:50:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f8abc-0877-4250-a6b9-7f5e72679636]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:50:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:53 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:50:53 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:53 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:50:53 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:50:53 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:50:54 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 07 10:50:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 1 in 0.774s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:50:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:50:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.671s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:50:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6dc3dd6-5777-431e-bf05-83d679351986', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:50:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-daef57c2-009d-432b-8b4b-eb4cd4058637 req-cf89b3b4-5d0f-4dcd-aae9-87e7b157c361 tempest-TestInstancesWithCinderVolumes-818461153 None] attachment_update completed successfully. Jul 07 10:51:04 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:INSERT=1,cinder:UPDATE=2,cinder:SELECT=6 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:51:04 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:51:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a10d3665-8170-4ed6-b8de-4090361b0247 req-97aeefb1-0d77-4531-be45-0768d9b09e3d tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a10d3665-8170-4ed6-b8de-4090361b0247 req-97aeefb1-0d77-4531-be45-0768d9b09e3d tempest-TestStampPattern-1879481931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:05 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[099a047c-00c4-40ea-a97c-18bbd48a26b2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a10d3665-8170-4ed6-b8de-4090361b0247 req-97aeefb1-0d77-4531-be45-0768d9b09e3d tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:05 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 Jul 07 10:51:05 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:06 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-a10d3665-8170-4ed6-b8de-4090361b0247 req-97aeefb1-0d77-4531-be45-0768d9b09e3d tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7" returned: 0 in 1.256s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-a10d3665-8170-4ed6-b8de-4090361b0247 req-97aeefb1-0d77-4531-be45-0768d9b09e3d tempest-TestStampPattern-1879481931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.283s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-a10d3665-8170-4ed6-b8de-4090361b0247 req-97aeefb1-0d77-4531-be45-0768d9b09e3d tempest-TestStampPattern-1879481931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-21731f72-0326-4cb1-bae1-84d70687a2e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3aeab612-41f0-4bf0-9c46-7733b206637a', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:51:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-a10d3665-8170-4ed6-b8de-4090361b0247 req-97aeefb1-0d77-4531-be45-0768d9b09e3d tempest-TestStampPattern-1879481931 None] attachment_update completed successfully. Jul 07 10:51:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-98ddeb73-39f6-49d4-a9ff-88f2288500f2 req-e4861ac9-ed91-4ee8-9ed0-a7178c02465a tempest-TestStampPattern-1879481931 None] Terminate volume connection completed successfully. Jul 07 10:51:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-98ddeb73-39f6-49d4-a9ff-88f2288500f2 req-e4861ac9-ed91-4ee8-9ed0-a7178c02465a tempest-TestStampPattern-1879481931 None] Deleting attachment 3aeab612-41f0-4bf0-9c46-7733b206637a. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-21731f72-0326-4cb1-bae1-84d70687a2e7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Lock "cinder-21731f72-0326-4cb1-bae1-84d70687a2e7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-quobyte-21731f72-0326-4cb1-bae1-84d70687a2e7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-21731f72-0326-4cb1-bae1-84d70687a2e7" acquired by "delete_volume" :: waited 0.012s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef71302-bc68-4f9f-be6e-b25eff41c225]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:51:23 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:23 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:23 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:51:23 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:24 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.951s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:51:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:51:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:51:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:51:24 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7" returned: 0 in 1.190s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:24 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7 Jul 07 10:51:24 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:25 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-21731f72-0326-4cb1-bae1-84d70687a2e7" returned: 0 in 0.707s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-21731f72-0326-4cb1-bae1-84d70687a2e7" released by "delete_volume" :: held 1.936s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Created reservations ['61533119-ad5a-4aee-b990-d0597efe3283', 'b60e43d8-da99-4d2f-b331-b1f621354e2b', '8437cb43-41f4-41e9-8ed0-0f6fc2df090f', '75f69c45-a4f1-4dc3-bb7a-4ba5f05edee9'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:25 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:51:25 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-23346348-e980-45fb-9e60-7d980e1ea76a-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Lock "cinder-23346348-e980-45fb-9e60-7d980e1ea76a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-quobyte-de9759b1-c515-4c65-aa25-50dec161042c" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-de9759b1-c515-4c65-aa25-50dec161042c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-quobyte-23346348-e980-45fb-9e60-7d980e1ea76a" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-23346348-e980-45fb-9e60-7d980e1ea76a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Deleting offline snapshot 23346348-e980-45fb-9e60-7d980e1ea76a of volume de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] snapshot_file for this snap is: volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7519aa6-b95d-4c69-a5d0-2bd16c3ec3d0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-591eaa3d-fe31-4b37-9891-3db286cb902a tempest-TestShelveInstance-1892212415 None] Terminate volume connection completed successfully. Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-591eaa3d-fe31-4b37-9891-3db286cb902a tempest-TestShelveInstance-1892212415 None] Deleting attachment 1228c5f5-665a-4cd3-be14-c964bbca7dde. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:51:26 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a Jul 07 10:51:26 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:26 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.693s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:51:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Deleted volume successfully. Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-61c23048-1c08-4e25-ba4e-7479e740c001 tempest-TestStampPattern-1879481931 None] Lock "cinder-21731f72-0326-4cb1-bae1-84d70687a2e7-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Acquiring lock "cinder-eedcddc3-4e06-444c-b793-067db97c36a5-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Lock "cinder-eedcddc3-4e06-444c-b793-067db97c36a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Acquiring lock "cinder-quobyte-eedcddc3-4e06-444c-b793-067db97c36a5" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:26 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a" returned: 0 in 0.757s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de9759b1-c515-4c65-aa25-50dec161042c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Lock "cinder-quobyte-eedcddc3-4e06-444c-b793-067db97c36a5" acquired by "delete_volume" :: waited 0.037s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c784ef9-f739-47e5-986d-6bb947b9fe8d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:27 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeebb19-a262-4335-a2f6-cce639c78ffd]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:27 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:51:27 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:27 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:51:27 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:27 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:27 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a Jul 07 10:51:27 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:27 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 0 in 0.788s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:27 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:51:27 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:28 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a" returned: 0 in 0.746s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:28 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a Jul 07 10:51:28 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:28 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 1 in 0.771s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:51:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:28 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5 Jul 07 10:51:28 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:29 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c.23346348-e980-45fb-9e60-7d980e1ea76a" returned: 0 in 0.675s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-23346348-e980-45fb-9e60-7d980e1ea76a" released by "_delete_snapshot" :: held 3.077s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-de9759b1-c515-4c65-aa25-50dec161042c" released by "delete_snapshot" :: held 3.097s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:29 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-eedcddc3-4e06-444c-b793-067db97c36a5" returned: 0 in 0.710s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Created reservations ['b81a5dca-1207-487e-98e7-10e554f7cd29', '79e98b08-ba88-462f-9455-e49e425fbb7b', '42bd5160-0a43-4e6f-a8f4-d9723d3431c5', '45bf792f-e936-432f-a186-0720365fd738'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Lock "cinder-quobyte-eedcddc3-4e06-444c-b793-067db97c36a5" released by "delete_volume" :: held 2.334s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Delete snapshot completed successfully. Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-44891eed-34f6-464b-abb9-59b93173f7fe tempest-TestStampPattern-1879481931 None] Lock "cinder-23346348-e980-45fb-9e60-7d980e1ea76a-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.quota [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Created reservations ['6aa7b02e-68ec-48e2-a792-b08f355b46e1', '201b1eb5-c59e-4a02-89a1-b35a76f876e6', '2e83b723-c154-472a-8db4-dc3655b50f0f', 'ebf8cb16-890e-4c20-b46c-16bdf3832555'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:29 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:51:29 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:30 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.658s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:30 devstack cinder-volume[87208]: DEBUG cinder.manager [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:51:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Deleted volume successfully. Jul 07 10:51:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [req-7151ac2e-f4ba-4931-a71b-35fca7527f1d req-fece71ff-cf6b-4beb-9693-a16537b4fce0 tempest-TestShelveInstance-1892212415 None] Lock "cinder-eedcddc3-4e06-444c-b793-067db97c36a5-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-f5fc7c68-a729-4fbc-ac43-e861fcf0b7cf req-f624fbeb-04a7-4c02-830e-307b071c98b0 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-f5fc7c68-a729-4fbc-ac43-e861fcf0b7cf req-f624fbeb-04a7-4c02-830e-307b071c98b0 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:31 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce42726-741e-417c-a12a-f7d7084c9fd5]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-f5fc7c68-a729-4fbc-ac43-e861fcf0b7cf req-f624fbeb-04a7-4c02-830e-307b071c98b0 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:32 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 Jul 07 10:51:32 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:32 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-f5fc7c68-a729-4fbc-ac43-e861fcf0b7cf req-f624fbeb-04a7-4c02-830e-307b071c98b0 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776" returned: 0 in 0.810s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-f5fc7c68-a729-4fbc-ac43-e861fcf0b7cf req-f624fbeb-04a7-4c02-830e-307b071c98b0 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-f5fc7c68-a729-4fbc-ac43-e861fcf0b7cf req-f624fbeb-04a7-4c02-830e-307b071c98b0 tempest-TestInstancesWithCinderVolumes-818461153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-5fe4349c-599e-44eb-9eb0-e5658448b776', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca60c687-1c15-4711-9b83-2a3bf62b402b', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:51:32 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-f5fc7c68-a729-4fbc-ac43-e861fcf0b7cf req-f624fbeb-04a7-4c02-830e-307b071c98b0 tempest-TestInstancesWithCinderVolumes-818461153 None] attachment_update completed successfully. Jul 07 10:51:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-de9759b1-c515-4c65-aa25-50dec161042c-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Lock "cinder-de9759b1-c515-4c65-aa25-50dec161042c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Acquiring lock "cinder-quobyte-de9759b1-c515-4c65-aa25-50dec161042c" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-de9759b1-c515-4c65-aa25-50dec161042c" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:38 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bf9110-37e2-4c89-bb9b-f7a2599402d8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:38 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:51:38 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:39 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 0.813s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:39 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c Jul 07 10:51:39 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:39 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-de9759b1-c515-4c65-aa25-50dec161042c" returned: 0 in 0.754s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Lock "cinder-quobyte-de9759b1-c515-4c65-aa25-50dec161042c" released by "delete_volume" :: held 1.630s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Created reservations ['79739fab-6368-493e-a5f3-e118efe00d67', 'e4cb64db-be37-49db-a987-b43bae712752', '25a26b5e-d9ea-419a-b343-3b496e0d290e', '4be1cb17-d0fb-41f4-affd-87b6d360b1d8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:40 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:51:40 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-4e54f586-ecbd-484f-94d1-472a3939bcef req-8e7ee906-2474-4678-82f1-3054f2462d1b tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-4e54f586-ecbd-484f-94d1-472a3939bcef req-8e7ee906-2474-4678-82f1-3054f2462d1b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ba9c7e-7d1b-4a89-a2e3-9d2f5b5b844d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-4e54f586-ecbd-484f-94d1-472a3939bcef req-8e7ee906-2474-4678-82f1-3054f2462d1b tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:40 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc Jul 07 10:51:40 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:40 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.803s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:51:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Deleted volume successfully. Jul 07 10:51:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-af555987-2972-4fac-b680-9ffcd81bc29b tempest-TestStampPattern-1879481931 None] Lock "cinder-de9759b1-c515-4c65-aa25-50dec161042c-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [req-4e54f586-ecbd-484f-94d1-472a3939bcef req-8e7ee906-2474-4678-82f1-3054f2462d1b tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc" returned: 0 in 0.900s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [req-4e54f586-ecbd-484f-94d1-472a3939bcef req-8e7ee906-2474-4678-82f1-3054f2462d1b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.922s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:41 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-4e54f586-ecbd-484f-94d1-472a3939bcef req-8e7ee906-2474-4678-82f1-3054f2462d1b tempest-TestInstancesWithCinderVolumes-818461153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5', 'name': 'volume-49322477-bdac-4eca-be98-c7841f18a2dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c49b2ff-99a5-49a5-95b4-efbe05f1ef7f', 'enforce_multipath': True} {{(pid=87208) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 10:51:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-4e54f586-ecbd-484f-94d1-472a3939bcef req-8e7ee906-2474-4678-82f1-3054f2462d1b tempest-TestInstancesWithCinderVolumes-818461153 None] attachment_update completed successfully. Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Flow 'volume_create_manager' (2049127c-2fa8-4552-b797-d1560c7ad6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cb75bc-c189-43bf-bdcc-b143f33d5c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cb75bc-c189-43bf-bdcc-b143f33d5c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a986780-eccf-4c81-b255-dab9e0467fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f7360d7406d474aaaa2c2cdbce8d273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:51:45Z,use_quota=True,user_id='c26422bb8c88406bbebb93dce4d6d785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1636020f-e7aa-4d14-80f4-2939e0698e23),volume_type_id=1636020f-e7aa-4d14-80f4-2939e0698e23)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d713efcb-30e8-4909-96d3-3efa555dd1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d713efcb-30e8-4909-96d3-3efa555dd1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f6c852-2874-4823-8f7d-ec7735a3ffbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f6c852-2874-4823-8f7d-ec7735a3ffbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a986780-eccf-4c81-b255-dab9e0467fbf', 'volume_name': 'volume-2a986780-eccf-4c81-b255-dab9e0467fbf', 'volume_size': 1, 'image_id': 'e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c0af1f64f1764cc728279ee9b0eae58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f7360d7406d474aaaa2c2cdbce8d273', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d282f102eb257a26c489cf09a1329e2507bca0ec713b2d19669210adade29832c2897925532ac49fe9321edc570bfee3251f6ca965bc541790295e8a11a73f4', 'id': 'e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'created_at': datetime.datetime(2026, 7, 7, 8, 51, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5822201-41b1-458d-9b82-1187d7b8c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5822201-41b1-458d-9b82-1187d7b8c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe1ba59-5325-4881-bb4f-1856246b32c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:45 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Volume 2a986780-eccf-4c81-b255-dab9e0467fbf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a986780-eccf-4c81-b255-dab9e0467fbf', 'volume_size': 1, 'image_id': 'e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c0af1f64f1764cc728279ee9b0eae58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f7360d7406d474aaaa2c2cdbce8d273', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d282f102eb257a26c489cf09a1329e2507bca0ec713b2d19669210adade29832c2897925532ac49fe9321edc570bfee3251f6ca965bc541790295e8a11a73f4', 'id': 'e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'created_at': datetime.datetime(2026, 7, 7, 8, 51, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Trying to clone 2a986780-eccf-4c81-b255-dab9e0467fbf from image e79a9066-4cad-452d-8c4e-bfc4c4a80c42 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:51:45 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Image download 0.00 MB at 0.00 MB/s Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047f977-e246-43df-a106-22cdfe22b784]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:45 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD Jul 07 10:51:45 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:46 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:46 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD Jul 07 10:51:46 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:47 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD" returned: 1 in 0.785s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:51:47 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Temporary image e79a9066-4cad-452d-8c4e-bfc4c4a80c42 is fetched for user c26422bb8c88406bbebb93dce4d6d785. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:51:47 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ed63bf-ab42-46ba-96f6-8cbbc8cc7faa]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:47 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD Jul 07 10:51:47 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:48 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD" returned: 0 in 0.922s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:48 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD Jul 07 10:51:48 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:49 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD" returned: 1 in 0.853s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a986780-eccf-4c81-b255-dab9e0467fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f7360d7406d474aaaa2c2cdbce8d273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:51:45Z,use_quota=True,user_id='c26422bb8c88406bbebb93dce4d6d785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1636020f-e7aa-4d14-80f4-2939e0698e23),volume_type_id=1636020f-e7aa-4d14-80f4-2939e0698e23)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Creating volume 2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:51:49 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:51:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:49 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf 1073741824 Jul 07 10:51:49 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:50 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf 1073741824" returned: 0 in 0.944s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:50 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf Jul 07 10:51:50 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:50 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf" returned: 0 in 0.736s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:51:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:50 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Attempting download of e79a9066-4cad-452d-8c4e-bfc4c4a80c42 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'metadata': {}}])) to volume 2a986780-eccf-4c81-b255-dab9e0467fbf. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:51:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0463dc-a31c-4a31-b06a-656a5310292e]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_m78z_zr9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:51 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_m78z_zr9 Jul 07 10:51:51 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-663d9483-4d7c-4e2e-aa5f-342b690f456e req-daa5c346-4872-4f97-b6dd-59a284aceef3 tempest-TestInstancesWithCinderVolumes-818461153 None] Terminate volume connection completed successfully. Jul 07 10:51:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-663d9483-4d7c-4e2e-aa5f-342b690f456e req-daa5c346-4872-4f97-b6dd-59a284aceef3 tempest-TestInstancesWithCinderVolumes-818461153 None] Deleting attachment ca60c687-1c15-4711-9b83-2a3bf62b402b. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:51:51 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_m78z_zr9" returned: 0 in 0.777s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_m78z_zr9 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:51 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_m78z_zr9 Jul 07 10:51:51 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Flow 'volume_create_manager' (7a5e5d0d-ed6f-4b0c-8897-a5b98378beff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28fa0f58-6b65-4a74-9801-5bf91527cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28fa0f58-6b65-4a74-9801-5bf91527cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-879552024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664651c7-7efe-43dd-9e44-5e9619cc1491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5800e0898add4753856562bd234555ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:51:52Z,use_quota=True,user_id='6d7ccf5cc1584882abb7b54e1a34c920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339ff1b2-86f9-4ca4-a8fd-2de7e690e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339ff1b2-86f9-4ca4-a8fd-2de7e690e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fd2f76-ff45-4df6-85ca-ba07d26ab613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fd2f76-ff45-4df6-85ca-ba07d26ab613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664651c7-7efe-43dd-9e44-5e9619cc1491', 'volume_name': 'volume-664651c7-7efe-43dd-9e44-5e9619cc1491', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25227dc7-8330-4724-a2ad-83ac047812c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25227dc7-8330-4724-a2ad-83ac047812c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8409fbb-16fe-4d28-8427-aaae32391c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:52 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Volume 664651c7-7efe-43dd-9e44-5e9619cc1491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664651c7-7efe-43dd-9e44-5e9619cc1491', 'volume_size': 1} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-879552024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664651c7-7efe-43dd-9e44-5e9619cc1491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5800e0898add4753856562bd234555ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:51:52Z,use_quota=True,user_id='6d7ccf5cc1584882abb7b54e1a34c920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Creating volume 664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:51:52 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:52 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 1073741824 Jul 07 10:51:52 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:52 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_m78z_zr9" returned: 1 in 0.781s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_m78z_zr9' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[68229d95-4a11-4861-b3c6-0e7936e607e2]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:52 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD Jul 07 10:51:52 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:53 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 1073741824" returned: 0 in 0.834s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:53 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 Jul 07 10:51:53 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:53 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:53 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD Jul 07 10:51:53 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "cinder-5fe4349c-599e-44eb-9eb0-e5658448b776-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-5fe4349c-599e-44eb-9eb0-e5658448b776-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "cinder-quobyte-5fe4349c-599e-44eb-9eb0-e5658448b776" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-quobyte-5fe4349c-599e-44eb-9eb0-e5658448b776" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e095a7f-0835-4621-9887-388306d41c71]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:53 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 Jul 07 10:51:53 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:53 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491" returned: 0 in 0.700s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8409fbb-16fe-4d28-8427-aaae32391c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664651c7-7efe-43dd-9e44-5e9619cc1491', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1d05c4-6381-4d8c-a562-11119f5afe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:54 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Volume volume-664651c7-7efe-43dd-9e44-5e9619cc1491 (664651c7-7efe-43dd-9e44-5e9619cc1491): created successfully Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1d05c4-6381-4d8c-a562-11119f5afe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Flow 'volume_create_manager' (7a5e5d0d-ed6f-4b0c-8897-a5b98378beff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:51:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5ff4af0a-e43b-4053-8b11-483a52c2263e tempest-VolumeDependencyTests-1553958870 None] Created volume successfully. Jul 07 10:51:54 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD" returned: 1 in 0.842s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] e79a9066-4cad-452d-8c4e-bfc4c4a80c42 was raw, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:54 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf Jul 07 10:51:54 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Creating offline snapshot 9a07eb41-4a01-458e-88d8-9d859823bbd8 of volume 664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc80bf9a-85e2-4ae2-ba19-ea4c25a2337e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:54 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776" returned: 0 in 0.945s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:54 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776 Jul 07 10:51:54 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:54 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 Jul 07 10:51:54 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:55 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf" returned: 0 in 0.878s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e79a9066-4cad-452d-8c4e-bfc4c4a80c42_aat4k49qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:51:55 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:55 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf 1G Jul 07 10:51:55 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:55 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-5fe4349c-599e-44eb-9eb0-e5658448b776" returned: 0 in 0.748s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:55 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-quobyte-5fe4349c-599e-44eb-9eb0-e5658448b776" released by "delete_volume" :: held 1.747s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491" returned: 0 in 0.845s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:55 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 1G Jul 07 10:51:55 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:55 devstack cinder-volume[87208]: WARNING cinder.quota [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766344164-1560397063 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766344164-1560397063, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:51:55 devstack cinder-volume[87208]: WARNING cinder.quota [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766344164-1560397063 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766344164-1560397063, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Created reservations ['be07580f-ac5a-43ea-92d6-b26a459fbcca', '3a1f327a-aaf0-4caf-9329-5596219c6647', '71c0b0fd-868d-4877-9ced-f67b7e90de7b', '60ba12cb-4ff1-4c7b-9598-16a5db76b4e6'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:55 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:51:55 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:55 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf 1G" returned: 0 in 0.818s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19df7ef-6f3c-4361-975f-f7518a7641d7]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:56 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf Jul 07 10:51:56 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:56 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 1G" returned: 0 in 0.981s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664651c7-7efe-43dd-9e44-5e9619cc1491 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:56 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664651c7-7efe-43dd-9e44-5e9619cc1491 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 Jul 07 10:51:56 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:56 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.753s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:56 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:51:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Deleted volume successfully. Jul 07 10:51:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-94ac903f-ab81-403a-b548-11e4b646c426 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-5fe4349c-599e-44eb-9eb0-e5658448b776-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:51:56 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf" returned: 0 in 0.823s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:56 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf Jul 07 10:51:56 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:57 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664651c7-7efe-43dd-9e44-5e9619cc1491 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:57 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 is being set with open permissions: ugo+rw Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:57 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 Jul 07 10:51:57 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:57 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf" returned: 1 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Downloaded image e79a9066-4cad-452d-8c4e-bfc4c4a80c42 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'metadata': {}}])) to volume 2a986780-eccf-4c81-b255-dab9e0467fbf successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Temporary image e79a9066-4cad-452d-8c4e-bfc4c4a80c42 for user c26422bb8c88406bbebb93dce4d6d785 is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Marking volume 2a986780-eccf-4c81-b255-dab9e0467fbf as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Copying metadata from image e79a9066-4cad-452d-8c4e-bfc4c4a80c42 to 2a986780-eccf-4c81-b255-dab9e0467fbf. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Creating volume glance metadata for volume 2a986780-eccf-4c81-b255-dab9e0467fbf backed by image e79a9066-4cad-452d-8c4e-bfc4c4a80c42 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0c0af1f64f1764cc728279ee9b0eae58', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe1ba59-5325-4881-bb4f-1856246b32c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a986780-eccf-4c81-b255-dab9e0467fbf', 'volume_size': 1, 'image_id': 'e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c0af1f64f1764cc728279ee9b0eae58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f7360d7406d474aaaa2c2cdbce8d273', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d282f102eb257a26c489cf09a1329e2507bca0ec713b2d19669210adade29832c2897925532ac49fe9321edc570bfee3251f6ca965bc541790295e8a11a73f4', 'id': 'e79a9066-4cad-452d-8c4e-bfc4c4a80c42', 'created_at': datetime.datetime(2026, 7, 7, 8, 51, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79a9066-4cad-452d-8c4e-bfc4c4a80c42/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b9a887-6b36-47ce-9bef-daaee6ce37ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:51:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Volume volume-2a986780-eccf-4c81-b255-dab9e0467fbf (2a986780-eccf-4c81-b255-dab9e0467fbf): created successfully Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b9a887-6b36-47ce-9bef-daaee6ce37ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Flow 'volume_create_manager' (2049127c-2fa8-4552-b797-d1560c7ad6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:51:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-da8b40eb-89b9-4774-950a-96edcc95c267 tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Created volume successfully. Jul 07 10:51:57 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8" returned: 0 in 0.640s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:57 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.info Jul 07 10:51:57 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Acquiring lock "cinder-2a986780-eccf-4c81-b255-dab9e0467fbf-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "cinder-2a986780-eccf-4c81-b255-dab9e0467fbf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Acquiring lock "cinder-quobyte-2a986780-eccf-4c81-b255-dab9e0467fbf" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "cinder-quobyte-2a986780-eccf-4c81-b255-dab9e0467fbf" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c9ead3-ee76-476b-b90b-9d1fcb95fd4f]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:58 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf Jul 07 10:51:58 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-e11666d2-1bd5-4467-90d3-8e570d287ea9 req-97aebc9f-a8f9-4bee-a095-9d293f5fb61b tempest-TestInstancesWithCinderVolumes-818461153 None] Terminate volume connection completed successfully. Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-e11666d2-1bd5-4467-90d3-8e570d287ea9 req-97aebc9f-a8f9-4bee-a095-9d293f5fb61b tempest-TestInstancesWithCinderVolumes-818461153 None] Deleting attachment 6c49b2ff-99a5-49a5-95b4-efbe05f1ef7f. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:51:58 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.info" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:58 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.info is being set with open permissions: ugo+rw Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:58 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.info Jul 07 10:51:58 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:58 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf" returned: 0 in 0.789s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:59 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf Jul 07 10:51:59 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:51:59 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.info" returned: 0 in 0.663s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.666s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:51:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-177b8272-8146-4b4d-9033-80b3c5df7a93 tempest-VolumeDependencyTests-1553958870 None] Create snapshot completed successfully Jul 07 10:51:59 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 07 10:51:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf" returned: 1 in 0.803s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:51:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:51:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:51:59 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf Jul 07 10:51:59 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Flow 'volume_create_manager' (1aeb8f2b-cf14-40fe-b03c-26c96c81e317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e732e1d-2282-471d-a929-08dca9494e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:00 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "cinder-49322477-bdac-4eca-be98-c7841f18a2dc-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e732e1d-2282-471d-a929-08dca9494e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1234884322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13342fdf-cf65-4686-ba4b-be9ae5432ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5800e0898add4753856562bd234555ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a07eb41-4a01-458e-88d8-9d859823bbd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:00Z,use_quota=True,user_id='6d7ccf5cc1584882abb7b54e1a34c920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa4223e-9e90-4f5a-8620-767b6aecce85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa4223e-9e90-4f5a-8620-767b6aecce85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4a9490-a49b-4bc4-a660-ccff00d14b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4a9490-a49b-4bc4-a660-ccff00d14b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13342fdf-cf65-4686-ba4b-be9ae5432ba6', 'volume_name': 'volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6', 'volume_size': 1, 'snapshot_id': '9a07eb41-4a01-458e-88d8-9d859823bbd8'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3d6fd2-7cf3-4514-8f6e-60d382c02fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3d6fd2-7cf3-4514-8f6e-60d382c02fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcafb48-4f15-4bd1-9829-6b460242321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:00 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Volume 13342fdf-cf65-4686-ba4b-be9ae5432ba6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6', 'volume_size': 1, 'snapshot_id': '9a07eb41-4a01-458e-88d8-9d859823bbd8'} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2a986780-eccf-4c81-b255-dab9e0467fbf" returned: 0 in 0.719s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-49322477-bdac-4eca-be98-c7841f18a2dc-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "cinder-quobyte-2a986780-eccf-4c81-b255-dab9e0467fbf" released by "delete_volume" :: held 2.402s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-quobyte-9a07eb41-4a01-458e-88d8-9d859823bbd8-13342fdf-cf65-4686-ba4b-be9ae5432ba6" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-9a07eb41-4a01-458e-88d8-9d859823bbd8-13342fdf-cf65-4686-ba4b-be9ae5432ba6" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Creating volume 13342fdf-cf65-4686-ba4b-be9ae5432ba6 from snapshot 9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-quobyte-13342fdf-cf65-4686-ba4b-be9ae5432ba6" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "cinder-quobyte-49322477-bdac-4eca-be98-c7841f18a2dc" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:00 devstack cinder-volume[87208]: WARNING cinder.quota [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:52:00 devstack cinder-volume[87208]: WARNING cinder.quota [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-13342fdf-cf65-4686-ba4b-be9ae5432ba6" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] snapshot: 9a07eb41-4a01-458e-88d8-9d859823bbd8, volume: 13342fdf-cf65-4686-ba4b-be9ae5432ba6, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-quobyte-49322477-bdac-4eca-be98-c7841f18a2dc" acquired by "delete_volume" :: waited 0.067s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bba7e4-536d-45aa-b395-1d920988d859]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[023af79a-1529-49f0-a7b1-a58f538013a1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Created reservations ['08c38840-4c31-495c-85e0-8716a5688901', 'a7e1fece-a63b-43b3-a97b-58edf6d6dae7', 'ba1e9922-6bb7-4dba-8c31-082a9ed5f8ea', '5ed0e3f7-17c7-46fc-8da1-0c393292b4ef'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:00 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 Jul 07 10:52:00 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:00 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc Jul 07 10:52:00 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:00 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:00 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:01 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8" returned: 0 in 0.974s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664651c7-7efe-43dd-9e44-5e9619cc1491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e504e9-4038-41d3-9d22-4ae4c3f585b9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:01 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc" returned: 0 in 0.999s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:01 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc Jul 07 10:52:01 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:01 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 Jul 07 10:52:01 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:01 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.007s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Deleted volume successfully. Jul 07 10:52:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c12a744b-0ed6-41d9-b4b4-826903c5962f tempest-VolumeAndVolumeTypeFromImageTest-207414538 None] Lock "cinder-2a986780-eccf-4c81-b255-dab9e0467fbf-delete_volume" released by "delete_volume" :: held 3.826s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:02 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-49322477-bdac-4eca-be98-c7841f18a2dc" returned: 0 in 0.917s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:02 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-quobyte-49322477-bdac-4eca-be98-c7841f18a2dc" released by "delete_volume" :: held 1.995s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491" returned: 0 in 0.974s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:02 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 Jul 07 10:52:02 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:02 devstack cinder-volume[87208]: WARNING cinder.quota [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74652537-1882092143 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74652537-1882092143, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:52:02 devstack cinder-volume[87208]: WARNING cinder.quota [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74652537-1882092143 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74652537-1882092143, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Created reservations ['f84b12f4-fe82-43da-8bce-4d0f86906e22', '62d2a5d6-61b0-414a-8122-8beeac983fa7', 'a7f12477-3ffa-40d3-b838-952cae21ab80', 'f6f4f1d3-3c9a-417f-9db5-b5b41437f1db'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:02 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:02 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:03 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.910s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:03 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Deleted volume successfully. Jul 07 10:52:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2e114de6-7214-4df1-a934-b544d5856015 tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-49322477-bdac-4eca-be98-c7841f18a2dc-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:09 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6" returned: 0 in 6.605s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:09 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dafae5c-20ac-4fcd-87a0-6f6f56dcd459]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:09 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 Jul 07 10:52:09 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [req-d1ade069-d086-4eaf-ac45-cc84c512d059 req-376123ae-d4fb-4600-8886-c11366996cf5 tempest-TestInstancesWithCinderVolumes-818461153 None] Terminate volume connection completed successfully. Jul 07 10:52:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [req-d1ade069-d086-4eaf-ac45-cc84c512d059 req-376123ae-d4fb-4600-8886-c11366996cf5 tempest-TestInstancesWithCinderVolumes-818461153 None] Deleting attachment d6dc3dd6-5777-431e-bf05-83d679351986. {{(pid=87208) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 10:52:10 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491" returned: 0 in 0.971s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:52:10 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Converted 1024.00 MB image at 155.01 MB/s Jul 07 10:52:10 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 is being set with open permissions: ugo+rw Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:10 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 Jul 07 10:52:10 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (40b3f195-ae77-4cd0-a991-b802fbf3ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9037824-2a3d-4322-b530-a9860d18a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9037824-2a3d-4322-b530-a9860d18a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523586931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e77d81-89a9-4d58-be2b-05a727630e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:11Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774d1b39-18dd-4830-a037-23292826fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774d1b39-18dd-4830-a037-23292826fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8366158-05b7-4dc7-a880-bc0101740241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8366158-05b7-4dc7-a880-bc0101740241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e77d81-89a9-4d58-be2b-05a727630e95', 'volume_name': 'volume-d1e77d81-89a9-4d58-be2b-05a727630e95', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6848ac36-ec9b-4fe9-9835-e34e880139cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6848ac36-ec9b-4fe9-9835-e34e880139cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0da2f1c-934b-400c-8b46-4153c995b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:10 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Volume d1e77d81-89a9-4d58-be2b-05a727630e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e77d81-89a9-4d58-be2b-05a727630e95', 'volume_size': 1} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:10 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6" returned: 0 in 0.703s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-13342fdf-cf65-4686-ba4b-be9ae5432ba6" released by "_copy_volume_from_snapshot" :: held 10.368s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-9a07eb41-4a01-458e-88d8-9d859823bbd8-13342fdf-cf65-4686-ba4b-be9ae5432ba6" released by "_create_volume_from_snapshot" :: held 10.419s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.446s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523586931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e77d81-89a9-4d58-be2b-05a727630e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:11Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Creating volume d1e77d81-89a9-4d58-be2b-05a727630e95 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:10 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:10 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 1073741824 Jul 07 10:52:10 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (5db5bb3d-57e5-4198-b327-0186514e5d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe835948-dc98-4e5a-b3e4-44c478c5ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcafb48-4f15-4bd1-9829-6b460242321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6', 'volume_size': 1, 'snapshot_id': '9a07eb41-4a01-458e-88d8-9d859823bbd8'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6651784-d9d8-4be4-92b3-93310d0390f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe835948-dc98-4e5a-b3e4-44c478c5ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858497658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a059a65-afb4-4397-8fc2-1f219621c9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:11Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c8ea7c-e0d7-4c9f-bccb-7214c0905c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c8ea7c-e0d7-4c9f-bccb-7214c0905c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27480d5a-fdfc-4ae6-9030-6c9e2a3410f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27480d5a-fdfc-4ae6-9030-6c9e2a3410f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a059a65-afb4-4397-8fc2-1f219621c9f5', 'volume_name': 'volume-4a059a65-afb4-4397-8fc2-1f219621c9f5', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada74218-f6e6-439c-989d-43e31585e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada74218-f6e6-439c-989d-43e31585e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ed7af8-fda5-4f51-9573-0e8947f886a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Volume 4a059a65-afb4-4397-8fc2-1f219621c9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a059a65-afb4-4397-8fc2-1f219621c9f5', 'volume_size': 1} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Volume volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 (13342fdf-cf65-4686-ba4b-be9ae5432ba6): created successfully Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6651784-d9d8-4be4-92b3-93310d0390f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Flow 'volume_create_manager' (1aeb8f2b-cf14-40fe-b03c-26c96c81e317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-131c2501-9ff2-424c-851a-e99e42adf1e9 tempest-VolumeDependencyTests-1553958870 None] Created volume successfully. Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (90990439-144e-41d7-809d-1802ddc6ccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2b9a84-7419-45ff-a0d0-a3e04d63662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2b9a84-7419-45ff-a0d0-a3e04d63662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003532454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c72394e-6214-4cd5-991f-01ee096fd5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:11Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218cbd44-3d24-4720-85dc-78144abc148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218cbd44-3d24-4720-85dc-78144abc148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bede7f32-2a23-494b-9316-f13d70ceaba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bede7f32-2a23-494b-9316-f13d70ceaba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c72394e-6214-4cd5-991f-01ee096fd5a2', 'volume_name': 'volume-0c72394e-6214-4cd5-991f-01ee096fd5a2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc6a587-6371-4398-9341-767668a79746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc6a587-6371-4398-9341-767668a79746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeeab6c7-b662-4179-bca9-1a9d9e17e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Volume 0c72394e-6214-4cd5-991f-01ee096fd5a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c72394e-6214-4cd5-991f-01ee096fd5a2', 'volume_size': 1} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-9a07eb41-4a01-458e-88d8-9d859823bbd8-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-9a07eb41-4a01-458e-88d8-9d859823bbd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-quobyte-664651c7-7efe-43dd-9e44-5e9619cc1491" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-664651c7-7efe-43dd-9e44-5e9619cc1491" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-quobyte-9a07eb41-4a01-458e-88d8-9d859823bbd8" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-9a07eb41-4a01-458e-88d8-9d859823bbd8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Deleting offline snapshot 9a07eb41-4a01-458e-88d8-9d859823bbd8 of volume 664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] snapshot_file for this snap is: volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e1ba9-03d4-487b-8165-5c1caabe573d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:11 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 Jul 07 10:52:11 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (9ee99cc5-bcf3-421c-8164-05d0e5e7ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff236337-ba20-49f8-8794-8fd0ff9da955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff236337-ba20-49f8-8794-8fd0ff9da955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234628392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:12Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6eac72-e4fc-47e1-a58b-6030dfec5886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6eac72-e4fc-47e1-a58b-6030dfec5886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce785ee-e7c3-496a-9b3b-f8d816470cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce785ee-e7c3-496a-9b3b-f8d816470cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7', 'volume_name': 'volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b73bf73-8ba4-4673-96d4-9f60fee7798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b73bf73-8ba4-4673-96d4-9f60fee7798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db07c251-768d-4ebb-b0e2-9e4887f13633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Volume e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7', 'volume_size': 1} Jul 07 10:52:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:12 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 1073741824" returned: 0 in 1.108s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:12 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 Jul 07 10:52:12 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (5c21571c-ba94-44d1-808f-2c96c90e1f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ee964c-78a4-4177-98a3-79bf4083cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ee964c-78a4-4177-98a3-79bf4083cec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-111669600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a24263-cf26-4e27-a569-773b9bae7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:12Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f86c2ec-8a0d-4487-9c22-41444027f8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f86c2ec-8a0d-4487-9c22-41444027f8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3179da-e9f6-4836-a9b3-b6c2b00916af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3179da-e9f6-4836-a9b3-b6c2b00916af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a24263-cf26-4e27-a569-773b9bae7344', 'volume_name': 'volume-95a24263-cf26-4e27-a569-773b9bae7344', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6aa559-13f0-4d6b-ba65-9f9270ac6072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6aa559-13f0-4d6b-ba65-9f9270ac6072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e55f70-851b-48a8-a52e-24bf74920727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:12 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Volume 95a24263-cf26-4e27-a569-773b9bae7344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a24263-cf26-4e27-a569-773b9bae7344', 'volume_size': 1} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:12 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8" returned: 0 in 0.887s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664651c7-7efe-43dd-9e44-5e9619cc1491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3cc3c-127c-48eb-881f-9494b7806133]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:12 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 Jul 07 10:52:12 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:12 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858497658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a059a65-afb4-4397-8fc2-1f219621c9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:11Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Creating volume 4a059a65-afb4-4397-8fc2-1f219621c9f5 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:12 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:12 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 1073741824 Jul 07 10:52:12 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0da2f1c-934b-400c-8b46-4153c995b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e77d81-89a9-4d58-be2b-05a727630e95', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395228ca-0212-4fe2-bc0d-d41070a959d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:12 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Volume volume-d1e77d81-89a9-4d58-be2b-05a727630e95 (d1e77d81-89a9-4d58-be2b-05a727630e95): created successfully Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395228ca-0212-4fe2-bc0d-d41070a959d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (40b3f195-ae77-4cd0-a991-b802fbf3ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ad2baaeb-318f-45b6-81cb-c74492120eb3 tempest-CreateVolumesFromImageTest-20910135 None] Created volume successfully. Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "cinder-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "cinder-quobyte-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-quobyte-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8c0ca6-f029-4c23-aec8-61626ebcecbc]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:13 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491" returned: 0 in 0.824s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:13 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 Jul 07 10:52:13 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:13 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:52:13 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:13 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 1073741824" returned: 0 in 0.844s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:13 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 Jul 07 10:52:13 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:14 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 0 in 0.775s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:14 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:14 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8 Jul 07 10:52:14 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:14 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:52:14 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:14 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5" returned: 0 in 0.688s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.947s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003532454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c72394e-6214-4cd5-991f-01ee096fd5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:11Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Creating volume 0c72394e-6214-4cd5-991f-01ee096fd5a2 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:14 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ed7af8-fda5-4f51-9573-0e8947f886a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a059a65-afb4-4397-8fc2-1f219621c9f5', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:14 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 1073741824 Jul 07 10:52:14 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d4213f-af29-4214-9792-eb63dcb83629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:14 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Volume volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 (4a059a65-afb4-4397-8fc2-1f219621c9f5): created successfully Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d4213f-af29-4214-9792-eb63dcb83629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (5db5bb3d-57e5-4198-b327-0186514e5d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6bfd9ed2-0b17-4f93-9f3a-59386bbb6f0a tempest-CreateVolumesFromImageTest-20910135 None] Created volume successfully. Jul 07 10:52:14 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491.9a07eb41-4a01-458e-88d8-9d859823bbd8" returned: 0 in 0.742s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:15 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 1 in 0.814s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-9a07eb41-4a01-458e-88d8-9d859823bbd8" released by "_delete_snapshot" :: held 3.335s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-664651c7-7efe-43dd-9e44-5e9619cc1491" released by "delete_snapshot" :: held 3.362s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:15 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6 Jul 07 10:52:15 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Created reservations ['03d07e5c-5e48-48de-aee4-752f27606cce', '2a4d4ca9-62b9-4a07-89af-a245b3884a73', '3210eabb-3435-4cf6-b8f1-337e8cb129bf', 'a20c42e5-4ae5-4b30-86a4-4080ed4b49ff'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:15 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Delete snapshot completed successfully. Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5bd78683-73d5-457f-8ac7-cd5b6546e811 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-9a07eb41-4a01-458e-88d8-9d859823bbd8-delete_snapshot" released by "delete_snapshot" :: held 3.539s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:15 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 1073741824" returned: 0 in 0.857s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:15 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 Jul 07 10:52:15 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:15 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-quobyte-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6" released by "delete_volume" :: held 2.350s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:15 devstack cinder-volume[87208]: WARNING cinder.quota [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369633255-2032703068 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369633255-2032703068, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:52:15 devstack cinder-volume[87208]: WARNING cinder.quota [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369633255-2032703068 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369633255-2032703068, it is now deprecated. Please use the default quota class for default quota. Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Created reservations ['26ff0307-a3fe-4ca7-9a83-b01de8e96676', 'e78b48c1-1d43-4a08-8edb-a721ab75bb0e', 'deabf061-9b89-40f7-8c0f-1e29463b71cd', 'c4ba8e27-6cd3-4ed9-b1fa-3a62018f5aa7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-664651c7-7efe-43dd-9e44-5e9619cc1491-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:15 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:15 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-664651c7-7efe-43dd-9e44-5e9619cc1491-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-quobyte-664651c7-7efe-43dd-9e44-5e9619cc1491" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-664651c7-7efe-43dd-9e44-5e9619cc1491" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[927e1b1f-4a8a-4653-b0af-cc1ba3fd3ad6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:16 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2" returned: 0 in 0.701s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.081s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234628392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:12Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Creating volume e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:16 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeeab6c7-b662-4179-bca9-1a9d9e17e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c72394e-6214-4cd5-991f-01ee096fd5a2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:16 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 1073741824 Jul 07 10:52:16 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce238622-e560-4542-8c73-7ccef4a74eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:16 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Volume volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 (0c72394e-6214-4cd5-991f-01ee096fd5a2): created successfully Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce238622-e560-4542-8c73-7ccef4a74eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (90990439-144e-41d7-809d-1802ddc6ccb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d84eba08-1004-4e3e-8196-30369e7a4f27 tempest-CreateVolumesFromImageTest-20910135 None] Created volume successfully. Jul 07 10:52:16 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 Jul 07 10:52:16 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:16 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.701s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Deleted volume successfully. Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ebfb7a3d-0f0a-4a91-bbbb-d7b61188c87b tempest-TestInstancesWithCinderVolumes-818461153 None] Lock "cinder-623d5ef9-e7ed-4ea6-a6e7-856d91b84ac6-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:16 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491" returned: 0 in 0.885s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:16 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491 Jul 07 10:52:16 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:16 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 1073741824" returned: 0 in 0.936s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:17 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 Jul 07 10:52:17 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:17 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-664651c7-7efe-43dd-9e44-5e9619cc1491" returned: 0 in 0.689s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-664651c7-7efe-43dd-9e44-5e9619cc1491" released by "delete_volume" :: held 1.636s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Created reservations ['587734e7-7a18-4784-aba6-4fb3a77153a4', '3ae3d7e1-e920-4f67-9b0f-5d2ba7ae8bda', 'b3db91ee-b5cc-4fe5-a9a3-1845ded729e7', '5427740a-7805-4db3-ba22-711fa04acd15'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:17 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7" returned: 0 in 0.723s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.355s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-111669600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a24263-cf26-4e27-a569-773b9bae7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dccf5c74e64d55bf059578f31554bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:12Z,use_quota=True,user_id='803b25b2729a4ed285c1506dfa097aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Creating volume 95a24263-cf26-4e27-a569-773b9bae7344 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:17 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:17 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:17 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db07c251-768d-4ebb-b0e2-9e4887f13633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:17 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 1073741824 Jul 07 10:52:17 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d8505d-43f1-4f12-af86-1a7c5feff52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:17 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Volume volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 (e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7): created successfully Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d8505d-43f1-4f12-af86-1a7c5feff52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (9ee99cc5-bcf3-421c-8164-05d0e5e7ac09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:17 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4379f5eb-2f3f-4110-ba3e-c12e839c2567 tempest-CreateVolumesFromImageTest-20910135 None] Created volume successfully. Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-13342fdf-cf65-4686-ba4b-be9ae5432ba6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-13342fdf-cf65-4686-ba4b-be9ae5432ba6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "cinder-quobyte-13342fdf-cf65-4686-ba4b-be9ae5432ba6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-13342fdf-cf65-4686-ba4b-be9ae5432ba6" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb974a5-8d40-4c3f-a1c4-96e531763390]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:18 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 Jul 07 10:52:18 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:18 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.814s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:18 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Deleted volume successfully. Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b0b3edc0-9da4-48d8-9571-7cb4f1440e34 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-664651c7-7efe-43dd-9e44-5e9619cc1491-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:18 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 1073741824" returned: 0 in 0.986s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:18 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 Jul 07 10:52:18 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:19 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6" returned: 0 in 0.935s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:19 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6 Jul 07 10:52:19 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:19 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e55f70-851b-48a8-a52e-24bf74920727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a24263-cf26-4e27-a569-773b9bae7344', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b870e6c5-b8e2-4d87-aac4-45c6c178a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:19 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Volume volume-95a24263-cf26-4e27-a569-773b9bae7344 (95a24263-cf26-4e27-a569-773b9bae7344): created successfully Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b870e6c5-b8e2-4d87-aac4-45c6c178a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Flow 'volume_create_manager' (5c21571c-ba94-44d1-808f-2c96c90e1f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ed365deb-d071-4951-8e6a-45daba8f184f tempest-CreateVolumesFromImageTest-20910135 None] Created volume successfully. Jul 07 10:52:19 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-13342fdf-cf65-4686-ba4b-be9ae5432ba6" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-quobyte-13342fdf-cf65-4686-ba4b-be9ae5432ba6" released by "delete_volume" :: held 1.694s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Created reservations ['c3aa4de8-0d2f-4fda-b181-2c5c89e9032d', '5e48cc3f-e42b-429d-b505-d6f274f50912', 'edf99166-179f-4c16-81bb-27c5fe992f35', '405fe929-0828-4643-ad06-0deaa1b148cc'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:20 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:20 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-95a24263-cf26-4e27-a569-773b9bae7344-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-95a24263-cf26-4e27-a569-773b9bae7344-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-quobyte-95a24263-cf26-4e27-a569-773b9bae7344" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-95a24263-cf26-4e27-a569-773b9bae7344" acquired by "delete_volume" :: waited 0.047s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d5e08c-5d4c-44f3-be41-660cdb63c5bc]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:20 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 Jul 07 10:52:20 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:21 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.893s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:21 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Deleted volume successfully. Jul 07 10:52:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-badb9094-e413-4b4e-beea-4e5fb61e4518 tempest-VolumeDependencyTests-1553958870 None] Lock "cinder-13342fdf-cf65-4686-ba4b-be9ae5432ba6-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:21 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344" returned: 0 in 1.209s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:21 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344 Jul 07 10:52:21 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:22 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-95a24263-cf26-4e27-a569-773b9bae7344" returned: 0 in 0.741s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-95a24263-cf26-4e27-a569-773b9bae7344" released by "delete_volume" :: held 2.044s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Created reservations ['fee3ede9-91ac-458f-915e-e11802b130a5', '8b4243ac-18ca-43cb-8a9b-f0e676403d9a', 'f962ec35-239d-4a63-b1f8-5d0bad5fffb7', '09692a19-ea97-4807-99d5-4f9d7199da9a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:22 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:22 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:23 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.692s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Deleted volume successfully. Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2ae47cc9-4767-459e-8878-ea2488514e94 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-95a24263-cf26-4e27-a569-773b9bae7344-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:23 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:23 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=123,cinder:SELECT=105,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=101,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=7 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-quobyte-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f56b0-941b-43e5-a300-bc41077961af]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:24 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 Jul 07 10:52:24 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Flow 'volume_create_manager' (3b151a8c-f1e2-45dd-b950-2a762bdecfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5c16ab-f644-47b4-9d23-e877101835c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5c16ab-f644-47b4-9d23-e877101835c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507626bb-9031-4c31-bd90-d865001ee93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbc7bd9df1c4bf29ceecac64aa8b790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:24Z,use_quota=True,user_id='5dd8ddd9e8fd43d5a4d5e207711f8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec106bf-83c4-484e-853b-25f697153ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec106bf-83c4-484e-853b-25f697153ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:24 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b03297-c025-49a4-b12d-056180549f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b03297-c025-49a4-b12d-056180549f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507626bb-9031-4c31-bd90-d865001ee93c', 'volume_name': 'volume-507626bb-9031-4c31-bd90-d865001ee93c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3e6fc3-9d64-4d97-aa33-b1261875182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3e6fc3-9d64-4d97-aa33-b1261875182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4a4f86-abe3-4db2-a7e9-762fbf199a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Volume 507626bb-9031-4c31-bd90-d865001ee93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507626bb-9031-4c31-bd90-d865001ee93c', 'volume_size': 1} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507626bb-9031-4c31-bd90-d865001ee93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbc7bd9df1c4bf29ceecac64aa8b790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:24Z,use_quota=True,user_id='5dd8ddd9e8fd43d5a4d5e207711f8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Creating volume 507626bb-9031-4c31-bd90-d865001ee93c {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:24 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.980s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:52:24 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c 1073741824 Jul 07 10:52:24 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:24 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7" returned: 0 in 0.910s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:24 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7 Jul 07 10:52:24 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:25 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7" returned: 0 in 0.794s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:25 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c 1073741824" returned: 0 in 0.962s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7" released by "delete_volume" :: held 1.767s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:25 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c Jul 07 10:52:25 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Created reservations ['18947d05-137c-4ea0-a43e-5b39038c6928', '13a6c89d-1161-4481-890c-216bc3355408', '1b79bf6a-4b8d-4c1b-a93f-98e34f7b2b9f', '7a5ec90c-f0cf-4ba2-8751-072b3d0e59e2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:25 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:25 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-0c72394e-6214-4cd5-991f-01ee096fd5a2-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-0c72394e-6214-4cd5-991f-01ee096fd5a2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-quobyte-0c72394e-6214-4cd5-991f-01ee096fd5a2" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-0c72394e-6214-4cd5-991f-01ee096fd5a2" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e6d8e-9b62-4240-a34c-e42f974064b6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:26 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 Jul 07 10:52:26 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:26 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c" returned: 0 in 0.813s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4a4f86-abe3-4db2-a7e9-762fbf199a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507626bb-9031-4c31-bd90-d865001ee93c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d36bce8-929d-45cc-b9f8-bc7d6c10744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:26 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Volume volume-507626bb-9031-4c31-bd90-d865001ee93c (507626bb-9031-4c31-bd90-d865001ee93c): created successfully Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d36bce8-929d-45cc-b9f8-bc7d6c10744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Flow 'volume_create_manager' (3b151a8c-f1e2-45dd-b950-2a762bdecfb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4b0729c3-f46a-4489-bdbb-00bc63ea9cc0 tempest-CinderUnicodeTest-518709240 None] Created volume successfully. Jul 07 10:52:26 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Deleted volume successfully. Jul 07 10:52:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e62610f-89f0-48a8-b12f-eb971fbc7f14 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-e7a02a1c-6bc1-4850-ba6e-2d1eae6722e7-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:27 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2" returned: 0 in 0.883s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:27 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2 Jul 07 10:52:27 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:27 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-0c72394e-6214-4cd5-991f-01ee096fd5a2" returned: 0 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-0c72394e-6214-4cd5-991f-01ee096fd5a2" released by "delete_volume" :: held 1.679s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Created reservations ['e3f8b95a-e663-4d0e-9df2-643fcc0f0b37', 'd1d9c172-3daa-4f03-93e1-9bd92b058231', '2bf93d98-747b-43d2-a13a-c6428bcff3c9', '762ac48a-366e-4279-8655-2f9ef45d2ea7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:27 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:27 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Flow 'volume_create_manager' (ca5e330a-aa10-4d9f-9701-059a48941003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0b34f9-1c26-454b-a5d2-746f9cc52854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-4a059a65-afb4-4397-8fc2-1f219621c9f5-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0b34f9-1c26-454b-a5d2-746f9cc52854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1510891757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659c81ad-b6ad-4134-a2a9-c9bd2c8186f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbc7bd9df1c4bf29ceecac64aa8b790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:28Z,use_quota=True,user_id='5dd8ddd9e8fd43d5a4d5e207711f8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c64f709-3e0e-45d4-9a52-66170f21dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c64f709-3e0e-45d4-9a52-66170f21dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b03016-3952-4a3b-861a-8704d3d962d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b03016-3952-4a3b-861a-8704d3d962d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659c81ad-b6ad-4134-a2a9-c9bd2c8186f4', 'volume_name': 'volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9314ed8-c600-485a-9f6b-7af51f259df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9314ed8-c600-485a-9f6b-7af51f259df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106db177-aebe-4e8a-9ad8-ef6ad51b8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:28 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Volume 659c81ad-b6ad-4134-a2a9-c9bd2c8186f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4', 'volume_size': 1} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1510891757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659c81ad-b6ad-4134-a2a9-c9bd2c8186f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbc7bd9df1c4bf29ceecac64aa8b790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:28Z,use_quota=True,user_id='5dd8ddd9e8fd43d5a4d5e207711f8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Creating volume 659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:28 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-4a059a65-afb4-4397-8fc2-1f219621c9f5-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:28 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 1073741824 Jul 07 10:52:28 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-quobyte-4a059a65-afb4-4397-8fc2-1f219621c9f5" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-4a059a65-afb4-4397-8fc2-1f219621c9f5" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b6272c-af60-4722-bfe1-0e4ddc25c760]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:28 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 Jul 07 10:52:28 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:28 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:28 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Deleted volume successfully. Jul 07 10:52:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4b80f24c-350f-4811-a2a1-9132ef328531 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-0c72394e-6214-4cd5-991f-01ee096fd5a2-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:29 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5" returned: 0 in 0.845s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:29 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 1073741824" returned: 0 in 0.995s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:29 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5 Jul 07 10:52:29 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:29 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 Jul 07 10:52:29 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:30 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a059a65-afb4-4397-8fc2-1f219621c9f5" returned: 0 in 0.705s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-4a059a65-afb4-4397-8fc2-1f219621c9f5" released by "delete_volume" :: held 1.601s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:30 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106db177-aebe-4e8a-9ad8-ef6ad51b8e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9acc9e9-bc2e-4a94-be76-a12393c84aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:30 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Volume volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 (659c81ad-b6ad-4134-a2a9-c9bd2c8186f4): created successfully Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9acc9e9-bc2e-4a94-be76-a12393c84aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Flow 'volume_create_manager' (ca5e330a-aa10-4d9f-9701-059a48941003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7e2ae6e2-b393-44ff-bad0-124a9faa4eef tempest-CinderUnicodeTest-518709240 None] Created volume successfully. Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Created reservations ['9b27785c-a068-46c1-8b52-48824f167aa9', 'b6d6c13e-1e0f-4ab2-adca-abb7acdf80b2', '6ca88e7f-8e19-47d8-8fde-38194350aa46', '1bc5967b-c875-4a24-a1ef-576e0e1816df'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:30 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:30 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-d1e77d81-89a9-4d58-be2b-05a727630e95-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-d1e77d81-89a9-4d58-be2b-05a727630e95-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "cinder-quobyte-d1e77d81-89a9-4d58-be2b-05a727630e95" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-d1e77d81-89a9-4d58-be2b-05a727630e95" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5bfbc4-a94e-4fee-acad-4a3e355ae3b8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Creating offline snapshot 16822628-5d88-4739-9f9b-a6a7e28f8858 of volume 659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[baadfca6-8e2d-4bb9-a293-a0f99ee7eb11]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:30 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 Jul 07 10:52:30 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:30 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 Jul 07 10:52:30 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:31 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.765s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:31 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Deleted volume successfully. Jul 07 10:52:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6687cb26-7d33-42d5-988e-7f794134a414 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-4a059a65-afb4-4397-8fc2-1f219621c9f5-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:31 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95" returned: 0 in 0.832s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:31 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95 Jul 07 10:52:31 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:31 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" returned: 0 in 0.829s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:31 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 1G Jul 07 10:52:31 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Flow 'volume_create_manager' (4a4e0088-507e-4b76-bbfb-f1a151f68cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a56d0b-7aa4-4b6c-beef-9d435fe007fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a56d0b-7aa4-4b6c-beef-9d435fe007fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4226ef22-8f2a-4e27-b9ad-a078cf3d31f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d63efec1e4bc9a9e8d2b6db344740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:32Z,use_quota=True,user_id='669613f4e6f2449a86d56613302d1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca40e581-2583-4dd4-b1cc-108f3b21c967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca40e581-2583-4dd4-b1cc-108f3b21c967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdea165c-f353-428d-ac97-dd971fb170b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:52:32 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d1e77d81-89a9-4d58-be2b-05a727630e95" returned: 0 in 0.711s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-quobyte-d1e77d81-89a9-4d58-be2b-05a727630e95" released by "delete_volume" :: held 1.592s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Created reservations ['01f0af86-ab73-40bf-ac70-5c35bc1ffce6', 'd084cc96-f4b3-41d2-9206-f6e328f76fe0', '22667f5d-052e-4cae-bc6c-3d019e8f5d83', '6b64cc25-3523-4e30-95cb-c1af6a0c1b21'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdea165c-f353-428d-ac97-dd971fb170b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4226ef22-8f2a-4e27-b9ad-a078cf3d31f7', 'volume_name': 'volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7', 'volume_size': 1, 'image_id': '2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ae64c4abbffa60dbdafe5d96dc7ddbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '758d63efec1e4bc9a9e8d2b6db344740', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '538914ea6c1266b4c1b76ad9a0e19a203b60f0f557c8db12dcda8f81e3b955baba19d625ce4c9b7bc3edbe1a6d6bc315666f1b8fcde37db24c1d806971d8ca81', 'id': '2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'created_at': datetime.datetime(2026, 7, 7, 8, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 52, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60/file', 'properties': {}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f7d60a-325c-41f9-8082-f480a7049d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f7d60a-325c-41f9-8082-f480a7049d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4238559-1d7d-41b7-bdc5-4b89ab1ef08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:32 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Volume 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7', 'volume_size': 1, 'image_id': '2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ae64c4abbffa60dbdafe5d96dc7ddbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '758d63efec1e4bc9a9e8d2b6db344740', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '538914ea6c1266b4c1b76ad9a0e19a203b60f0f557c8db12dcda8f81e3b955baba19d625ce4c9b7bc3edbe1a6d6bc315666f1b8fcde37db24c1d806971d8ca81', 'id': '2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'created_at': datetime.datetime(2026, 7, 7, 8, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 52, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60/file', 'properties': {}}, 'image_service': } Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Trying to clone 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 from image 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:32 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:32 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:32 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:52:32 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Image download 0.00 MB at 0.00 MB/s Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 1G" returned: 0 in 0.895s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:32 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 Jul 07 10:52:32 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc56f28-d0b9-4d40-863c-9112376754be]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:32 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD Jul 07 10:52:32 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:33 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.701s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Deleted volume successfully. Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bee49e3f-7b92-4499-83f5-e544c7243810 tempest-CreateVolumesFromImageTest-20910135 None] Lock "cinder-d1e77d81-89a9-4d58-be2b-05a727630e95-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:33 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858" returned: 0 in 0.749s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:33 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 is being set with open permissions: ugo+rw Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:33 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 Jul 07 10:52:33 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:33 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD" returned: 0 in 0.850s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:33 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD Jul 07 10:52:33 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:33 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858" returned: 0 in 0.703s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:34 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.info Jul 07 10:52:34 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:34 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD" returned: 1 in 0.818s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Temporary image 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 is fetched for user 669613f4e6f2449a86d56613302d1718. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde85f99-5cf1-4ff6-a654-c3e7e8fa7145]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:34 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD Jul 07 10:52:34 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:34 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.info" returned: 0 in 0.729s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:34 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.info is being set with open permissions: ugo+rw Jul 07 10:52:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:34 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.info Jul 07 10:52:34 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:35 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:35 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD Jul 07 10:52:35 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:35 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.info" returned: 0 in 0.694s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.731s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:35 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6b31e207-a973-43f1-8f14-7ed011ae3ba0 tempest-CinderUnicodeTest-518709240 None] Create snapshot completed successfully Jul 07 10:52:35 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD" returned: 1 in 0.776s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4226ef22-8f2a-4e27-b9ad-a078cf3d31f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d63efec1e4bc9a9e8d2b6db344740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:32Z,use_quota=True,user_id='669613f4e6f2449a86d56613302d1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Creating volume 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:35 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:35 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 1073741824 Jul 07 10:52:35 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (8b9fc092-4815-4bf1-9a63-df0af585edb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2cb2f8-274c-4d6e-955e-53966b76d307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "cinder-16822628-5d88-4739-9f9b-a6a7e28f8858-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2cb2f8-274c-4d6e-955e-53966b76d307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500751029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea385101-fa27-41bf-a0d3-5cfd6bde0df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:36Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36de0b8e-efa6-45a6-a488-897e12f0b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36de0b8e-efa6-45a6-a488-897e12f0b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5786dfc9-7af3-4a9f-9b4e-0f41518d5963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5786dfc9-7af3-4a9f-9b4e-0f41518d5963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea385101-fa27-41bf-a0d3-5cfd6bde0df4', 'volume_name': 'volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b5850e-f64e-4263-b820-fd3202d4ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b5850e-f64e-4263-b820-fd3202d4ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1331e1eb-241f-4ffc-b150-19bb08aaba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume ea385101-fa27-41bf-a0d3-5cfd6bde0df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4', 'volume_size': 1} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-16822628-5d88-4739-9f9b-a6a7e28f8858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "cinder-quobyte-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "cinder-quobyte-16822628-5d88-4739-9f9b-a6a7e28f8858" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-16822628-5d88-4739-9f9b-a6a7e28f8858" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Deleting offline snapshot 16822628-5d88-4739-9f9b-a6a7e28f8858 of volume 659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] snapshot_file for this snap is: volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5056a-5015-49bb-aa8d-8d50b5a1dfa6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:36 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 Jul 07 10:52:36 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:36 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 1073741824" returned: 0 in 0.854s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:36 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 Jul 07 10:52:36 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:36 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858" returned: 0 in 0.774s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0338b88-ec1f-446a-b8ca-2451e037fc39]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:37 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 Jul 07 10:52:37 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:37 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" returned: 0 in 0.656s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500751029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea385101-fa27-41bf-a0d3-5cfd6bde0df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:36Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Creating volume ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:37 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:37 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 1073741824 Jul 07 10:52:37 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Attempting download of 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 ((None, [{'url': 'file:///opt/stack/data/glance/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'metadata': {}}])) to volume 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e08492-ff2c-4b4b-a0ac-2f0f50b6833b]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60__76_mpm8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:37 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60__76_mpm8 Jul 07 10:52:37 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:37 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" returned: 0 in 0.770s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:37 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 Jul 07 10:52:37 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:38 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60__76_mpm8" returned: 0 in 0.735s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60__76_mpm8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:38 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 1073741824" returned: 0 in 0.853s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:38 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 Jul 07 10:52:38 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:38 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60__76_mpm8 Jul 07 10:52:38 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:38 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858" returned: 0 in 0.801s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:38 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858 Jul 07 10:52:38 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:39 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:39 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60__76_mpm8" returned: 1 in 0.743s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60__76_mpm8' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ec327-53fd-47bf-ab14-947023386373]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1331e1eb-241f-4ffc-b150-19bb08aaba69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c4ad97-a7d8-4678-a417-ea3ab5b4c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:39 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 (ea385101-fa27-41bf-a0d3-5cfd6bde0df4): created successfully Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c4ad97-a7d8-4678-a417-ea3ab5b4c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (8b9fc092-4815-4bf1-9a63-df0af585edb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a3ae5178-92fb-4519-a288-d074d175a5be tempest-CreateVolumesFromSnapshotTest-38293813 None] Created volume successfully. Jul 07 10:52:39 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD Jul 07 10:52:39 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:39 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4.16822628-5d88-4739-9f9b-a6a7e28f8858" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-16822628-5d88-4739-9f9b-a6a7e28f8858" released by "_delete_snapshot" :: held 3.121s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" released by "delete_snapshot" :: held 3.143s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Created reservations ['1efdad4d-08d8-4974-b481-4bcd8d21d8fc', '7431c7b8-1ea6-4d87-a6bc-37c2ce7492ca', '6e8e4a8b-5b4c-42f7-8d4e-a72bc4b97350', 'ef222727-ac11-4fee-9fab-1afec4ae324d'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Delete snapshot completed successfully. Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-be4494cb-b1a9-4b27-b95a-51820e171c98 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-16822628-5d88-4739-9f9b-a6a7e28f8858-delete_snapshot" released by "delete_snapshot" :: held 3.268s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:39 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:39 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD Jul 07 10:52:39 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "cinder-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "cinder-quobyte-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6516f836-878f-4c9e-885d-cc85c551b46e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Creating offline snapshot 15ddaf20-c954-409c-b3fa-307037262c04 of volume ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa657aee-e1e2-4405-8706-de817506a8a9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:40 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 Jul 07 10:52:40 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:40 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 Jul 07 10:52:40 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:40 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD" returned: 1 in 0.774s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 was raw, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:52:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:40 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 Jul 07 10:52:40 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:41 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" returned: 0 in 0.799s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:41 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" returned: 0 in 0.781s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:41 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4 Jul 07 10:52:41 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:41 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 1G Jul 07 10:52:41 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:41 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" returned: 0 in 0.740s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60_z4yis08jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:52:41 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:41 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 1G Jul 07 10:52:41 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:41 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4" released by "delete_volume" :: held 1.546s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:41 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Created reservations ['ced3a991-4720-418e-9818-89fc017347ff', '7af65102-7748-4b8e-80b0-6ec72b93c7b8', 'b3f535a1-1293-42a7-a61d-7d0b32634162', '5bf4591b-6043-4e01-8ee9-a3cd3656dc54'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:42 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 1G" returned: 0 in 0.831s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:42 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:42 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:42 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:42 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 Jul 07 10:52:42 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 1G" returned: 0 in 0.774s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1038273a-6fcb-426f-ac24-4040bcb2605f]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:42 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 Jul 07 10:52:42 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Acquiring lock "cinder-507626bb-9031-4c31-bd90-d865001ee93c-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Lock "cinder-507626bb-9031-4c31-bd90-d865001ee93c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Acquiring lock "cinder-quobyte-507626bb-9031-4c31-bd90-d865001ee93c" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-507626bb-9031-4c31-bd90-d865001ee93c" acquired by "delete_volume" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:42 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Deleted volume successfully. Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[33831c0a-5bbd-408f-92ed-280b47b57479]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f6b611e8-8d35-4bad-93f4-eb237b47ca60 tempest-CinderUnicodeTest-518709240 None] Lock "cinder-659c81ad-b6ad-4134-a2a9-c9bd2c8186f4-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:42 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c Jul 07 10:52:42 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:42 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:42 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 is being set with open permissions: ugo+rw Jul 07 10:52:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:42 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 Jul 07 10:52:42 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:43 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" returned: 0 in 0.902s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:43 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 Jul 07 10:52:43 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:43 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:43 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04" returned: 0 in 0.655s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c" returned: 0 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:43 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c Jul 07 10:52:43 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:43 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.info Jul 07 10:52:43 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:43 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" returned: 1 in 0.783s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Downloaded image 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 ((None, [{'url': 'file:///opt/stack/data/glance/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'metadata': {}}])) to volume 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Temporary image 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 for user 669613f4e6f2449a86d56613302d1718 is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Marking volume 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Copying metadata from image 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 to 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Creating volume glance metadata for volume 4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 backed by image 2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60 with: {'image_id': '2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8ae64c4abbffa60dbdafe5d96dc7ddbe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4238559-1d7d-41b7-bdc5-4b89ab1ef08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7', 'volume_size': 1, 'image_id': '2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ae64c4abbffa60dbdafe5d96dc7ddbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '758d63efec1e4bc9a9e8d2b6db344740', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '538914ea6c1266b4c1b76ad9a0e19a203b60f0f557c8db12dcda8f81e3b955baba19d625ce4c9b7bc3edbe1a6d6bc315666f1b8fcde37db24c1d806971d8ca81', 'id': '2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60', 'created_at': datetime.datetime(2026, 7, 7, 8, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 52, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cb39a59-61fb-4b07-9cb2-a6c9c2e2fd60/file', 'properties': {}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a2ce00-d8cc-444e-849f-f74389d4a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Volume volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 (4226ef22-8f2a-4e27-b9ad-a078cf3d31f7): created successfully Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a2ce00-d8cc-444e-849f-f74389d4a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Flow 'volume_create_manager' (4a4e0088-507e-4b76-bbfb-f1a151f68cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-44db6f93-e7c0-4f7b-85d0-4baf6712a7c1 tempest-VolumeImageDependencyTests-1706335552 None] Created volume successfully. Jul 07 10:52:44 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-507626bb-9031-4c31-bd90-d865001ee93c" returned: 0 in 0.680s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Lock "cinder-quobyte-507626bb-9031-4c31-bd90-d865001ee93c" released by "delete_volume" :: held 1.576s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:44 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Created reservations ['ad29a897-cb5d-4aac-8f36-629f400c0bbd', 'b71ca139-41f6-4079-9b33-444b5ad66b90', '77e955e4-092c-45c7-b3a6-99e92d4a8e10', 'e0afaf5f-2261-4706-ad04-781ba51fb459'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.info" returned: 0 in 0.677s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:44 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.info is being set with open permissions: ugo+rw Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:44 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.info Jul 07 10:52:44 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:44 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:44 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:44 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.info" returned: 0 in 0.685s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.640s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:45 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Acquiring lock "cinder-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-70886d61-747f-4ebe-8071-76ec2af0d80f tempest-CreateVolumesFromSnapshotTest-38293813 None] Create snapshot completed successfully Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.712s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Deleted volume successfully. Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Lock "cinder-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8d64a864-f92d-47e6-bfb3-fb288d4694df tempest-CinderUnicodeTest-518709240 None] Lock "cinder-507626bb-9031-4c31-bd90-d865001ee93c-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Acquiring lock "cinder-quobyte-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Lock "cinder-quobyte-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ff04b6-2072-4ab7-abe4-09b0fac8abf5]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:45 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 Jul 07 10:52:45 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:46 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" returned: 0 in 0.883s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (0c90f2e7-7a53-47ae-bb1e-9386e07cecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5b0d63-57ff-41ba-ac1f-4b5acd0978ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5b0d63-57ff-41ba-ac1f-4b5acd0978ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2103332402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3770ed87-061c-4f13-87f6-a808f8910c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:46Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e812e576-e7b7-410c-861c-cd2ce90185ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e812e576-e7b7-410c-861c-cd2ce90185ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c510cfc-5a50-47c1-8e30-948459f8de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c510cfc-5a50-47c1-8e30-948459f8de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3770ed87-061c-4f13-87f6-a808f8910c31', 'volume_name': 'volume-3770ed87-061c-4f13-87f6-a808f8910c31', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9adb38-47b8-4b58-8f35-c213a96efe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9adb38-47b8-4b58-8f35-c213a96efe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 Jul 07 10:52:46 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77764fe1-118a-41f7-8009-a4fa14be78cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume 3770ed87-061c-4f13-87f6-a808f8910c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3770ed87-061c-4f13-87f6-a808f8910c31', 'volume_size': 1} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2103332402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3770ed87-061c-4f13-87f6-a808f8910c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:46Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Creating volume 3770ed87-061c-4f13-87f6-a808f8910c31 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:46 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:46 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 1073741824 Jul 07 10:52:46 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (8c456f12-8ba7-42cb-8114-fa236bdce0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a01b09-e3c6-4c8e-8731-3d59f4d1a319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a01b09-e3c6-4c8e-8731-3d59f4d1a319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511514975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd9db26-0ef3-46ef-96e3-ae3947982150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:47Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d17be-953d-49ee-82cc-4c3c2b1916a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d17be-953d-49ee-82cc-4c3c2b1916a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4795c50-730f-4c82-93f1-74f63fc67466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4795c50-730f-4c82-93f1-74f63fc67466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd9db26-0ef3-46ef-96e3-ae3947982150', 'volume_name': 'volume-acd9db26-0ef3-46ef-96e3-ae3947982150', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d188b68-acbd-4de4-9558-a2693f06fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d188b68-acbd-4de4-9558-a2693f06fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92682951-7a2b-4c70-ac89-3a4a3c176a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:46 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume acd9db26-0ef3-46ef-96e3-ae3947982150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd9db26-0ef3-46ef-96e3-ae3947982150', 'volume_size': 1} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (4e4136ea-938e-4ac0-834d-d736ce9b1970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ba9552-0a5a-4b02-8f54-267319dbfd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ba9552-0a5a-4b02-8f54-267319dbfd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104173986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db6884b-7614-4eff-b257-d2bd9dab43b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:47Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc2e6a6-892c-4d74-8447-691155c01b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc2e6a6-892c-4d74-8447-691155c01b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365140d6-f9df-4439-944e-d20d5a7bba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365140d6-f9df-4439-944e-d20d5a7bba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db6884b-7614-4eff-b257-d2bd9dab43b1', 'volume_name': 'volume-3db6884b-7614-4eff-b257-d2bd9dab43b1', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9599f4-0e0d-4833-b064-b7d63b646cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9599f4-0e0d-4833-b064-b7d63b646cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5881b3-344b-4f8d-a984-1b6015389291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume 3db6884b-7614-4eff-b257-d2bd9dab43b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db6884b-7614-4eff-b257-d2bd9dab43b1', 'volume_size': 1} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:47 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" returned: 1 in 0.985s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:47 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7 Jul 07 10:52:47 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (aab2d23f-bad5-47e4-83a6-c36de35a361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca793b6-af67-4b95-8661-287665acf872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca793b6-af67-4b95-8661-287665acf872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122055318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c5431f-2b0d-48fe-8af5-918c218c4c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:47Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc39f94-f5f0-4f1c-b8d8-6d997ba47edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc39f94-f5f0-4f1c-b8d8-6d997ba47edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a8c23b-48f9-43d4-afa6-9989856b3461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a8c23b-48f9-43d4-afa6-9989856b3461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c5431f-2b0d-48fe-8af5-918c218c4c06', 'volume_name': 'volume-89c5431f-2b0d-48fe-8af5-918c218c4c06', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c15d39-8262-46c6-b25d-505cf4a28606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c15d39-8262-46c6-b25d-505cf4a28606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4204587e-a461-440f-9ff7-c9f4e21ff383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume 89c5431f-2b0d-48fe-8af5-918c218c4c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c5431f-2b0d-48fe-8af5-918c218c4c06', 'volume_size': 1} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 1073741824" returned: 0 in 1.357s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:47 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 Jul 07 10:52:47 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (c1942636-9a38-42f0-93c4-604739d270ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecd8ef4-834e-443d-9f99-077ed0f537ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:47 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecd8ef4-834e-443d-9f99-077ed0f537ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-69668120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f3657-338d-428f-b43d-5d1cbe42e866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:48Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b503be5e-b71b-49ac-9cfb-a12287030285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b503be5e-b71b-49ac-9cfb-a12287030285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d03d7b-9f46-458e-88ec-63984f86d800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d03d7b-9f46-458e-88ec-63984f86d800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7f3657-338d-428f-b43d-5d1cbe42e866', 'volume_name': 'volume-ed7f3657-338d-428f-b43d-5d1cbe42e866', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:48 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03043bab-5a3d-4818-ada9-77b860d24e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03043bab-5a3d-4818-ada9-77b860d24e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e99ba5f-c0e2-474b-a813-73066cc48c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume ed7f3657-338d-428f-b43d-5d1cbe42e866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7f3657-338d-428f-b43d-5d1cbe42e866', 'volume_size': 1} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" returned: 0 in 0.944s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Lock "cinder-quobyte-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7" released by "delete_volume" :: held 2.878s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Created reservations ['8b107294-7e8d-4336-a93a-291f54ea5912', 'ea7f9e2b-73bb-47d2-85a7-19957496fa10', 'e3bd03ba-710d-4e7b-a79d-d76f04497497', 'e920387a-1c96-4705-b12e-7c8dbeb05545'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:48 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:48 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:48 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31" returned: 0 in 0.771s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511514975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd9db26-0ef3-46ef-96e3-ae3947982150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:47Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Creating volume acd9db26-0ef3-46ef-96e3-ae3947982150 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:48 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:48 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 1073741824 Jul 07 10:52:48 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77764fe1-118a-41f7-8009-a4fa14be78cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3770ed87-061c-4f13-87f6-a808f8910c31', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796c6034-f3a6-45b1-9116-6c6bc8ba4289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume volume-3770ed87-061c-4f13-87f6-a808f8910c31 (3770ed87-061c-4f13-87f6-a808f8910c31): created successfully Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796c6034-f3a6-45b1-9116-6c6bc8ba4289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (0c90f2e7-7a53-47ae-bb1e-9386e07cecd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-706b8cc9-85ec-49f5-8af6-f0c602adfc90 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created volume successfully. Jul 07 10:52:49 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.851s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:49 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Deleted volume successfully. Jul 07 10:52:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-543e2056-115d-4135-93fc-5bb326b35f58 tempest-VolumeImageDependencyTests-1706335552 None] Lock "cinder-4226ef22-8f2a-4e27-b9ad-a078cf3d31f7-delete_volume" released by "delete_volume" :: held 3.939s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:49 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 1073741824" returned: 0 in 1.084s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:49 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 Jul 07 10:52:49 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:50 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150" returned: 0 in 0.794s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.388s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104173986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db6884b-7614-4eff-b257-d2bd9dab43b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:47Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Creating volume 3db6884b-7614-4eff-b257-d2bd9dab43b1 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:50 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92682951-7a2b-4c70-ac89-3a4a3c176a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd9db26-0ef3-46ef-96e3-ae3947982150', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:50 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 1073741824 Jul 07 10:52:50 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8dbbef-aa24-423c-a2e5-8b140cecde2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:50 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume volume-acd9db26-0ef3-46ef-96e3-ae3947982150 (acd9db26-0ef3-46ef-96e3-ae3947982150): created successfully Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8dbbef-aa24-423c-a2e5-8b140cecde2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (8c456f12-8ba7-42cb-8114-fa236bdce0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3ae258e2-d243-428e-8946-eaf9c6f15fc7 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created volume successfully. Jul 07 10:52:51 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 1073741824" returned: 0 in 0.918s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:51 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 Jul 07 10:52:51 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:52 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1" returned: 0 in 0.680s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.429s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122055318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c5431f-2b0d-48fe-8af5-918c218c4c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:47Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Creating volume 89c5431f-2b0d-48fe-8af5-918c218c4c06 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:52 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5881b3-344b-4f8d-a984-1b6015389291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db6884b-7614-4eff-b257-d2bd9dab43b1', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:52 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 1073741824 Jul 07 10:52:52 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30da1c8b-6587-4ca8-b1f2-a85588309e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:52 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 (3db6884b-7614-4eff-b257-d2bd9dab43b1): created successfully Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30da1c8b-6587-4ca8-b1f2-a85588309e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (4e4136ea-938e-4ac0-834d-d736ce9b1970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:52 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ec47223e-3691-4219-92eb-3d1f5f29170e tempest-CreateVolumesFromSnapshotTest-38293813 None] Created volume successfully. Jul 07 10:52:52 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 1073741824" returned: 0 in 0.824s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:52 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 Jul 07 10:52:52 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:53 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06" returned: 0 in 0.638s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.566s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-69668120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f3657-338d-428f-b43d-5d1cbe42e866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816210fdc6c74ef58b4e8d0ba5980575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:52:48Z,use_quota=True,user_id='13f844bafd024d89bda13e71d5774d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Creating volume ed7f3657-338d-428f-b43d-5d1cbe42e866 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:52:53 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4204587e-a461-440f-9ff7-c9f4e21ff383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c5431f-2b0d-48fe-8af5-918c218c4c06', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:53 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 1073741824 Jul 07 10:52:53 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413c8572-ac40-4c5d-ad66-4d59884a0327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:53 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 (89c5431f-2b0d-48fe-8af5-918c218c4c06): created successfully Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413c8572-ac40-4c5d-ad66-4d59884a0327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:53 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (aab2d23f-bad5-47e4-83a6-c36de35a361f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-87396ca2-f0ef-49f0-b728-496ba6a41999 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created volume successfully. Jul 07 10:52:54 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 1073741824" returned: 0 in 0.788s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:54 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 Jul 07 10:52:54 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:55 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866" returned: 0 in 0.638s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e99ba5f-c0e2-474b-a813-73066cc48c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7f3657-338d-428f-b43d-5d1cbe42e866', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa27325a-d78b-4f0a-8ff2-f8ad4dc1e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:52:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Volume volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 (ed7f3657-338d-428f-b43d-5d1cbe42e866): created successfully Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa27325a-d78b-4f0a-8ff2-f8ad4dc1e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Flow 'volume_create_manager' (c1942636-9a38-42f0-93c4-604739d270ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:52:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b2fc9ebd-3db7-4ec0-bd0c-53703bf3a076 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created volume successfully. Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-ed7f3657-338d-428f-b43d-5d1cbe42e866-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-ed7f3657-338d-428f-b43d-5d1cbe42e866-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-ed7f3657-338d-428f-b43d-5d1cbe42e866" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-ed7f3657-338d-428f-b43d-5d1cbe42e866" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d417ec-6f0e-4757-b821-29ffbb979ac8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:55 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 Jul 07 10:52:55 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:56 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866" returned: 0 in 0.730s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:56 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866 Jul 07 10:52:56 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:57 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ed7f3657-338d-428f-b43d-5d1cbe42e866" returned: 0 in 0.636s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-ed7f3657-338d-428f-b43d-5d1cbe42e866" released by "delete_volume" :: held 1.405s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Created reservations ['6d575cf8-c635-4811-8f24-a5f855a00513', '7b28dc3c-b454-491f-b330-a04fc5e518ba', '33d19a1c-f17f-4171-9818-c1266d02ad0a', '78c8e383-c045-454c-825d-bcd614c0dbe8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:57 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:57 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:57 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-89c5431f-2b0d-48fe-8af5-918c218c4c06-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.634s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:52:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Deleted volume successfully. Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-89c5431f-2b0d-48fe-8af5-918c218c4c06-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f8a7c7c1-1188-40cb-9697-9e10ebcb2ecf tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-ed7f3657-338d-428f-b43d-5d1cbe42e866-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-89c5431f-2b0d-48fe-8af5-918c218c4c06" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-89c5431f-2b0d-48fe-8af5-918c218c4c06" acquired by "delete_volume" :: waited 0.012s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f144746-f97b-4275-9f1b-b11459fe553a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:52:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:58 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 Jul 07 10:52:58 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:58 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06" returned: 0 in 0.747s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:58 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06 Jul 07 10:52:58 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:52:59 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-89c5431f-2b0d-48fe-8af5-918c218c4c06" returned: 0 in 0.635s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-89c5431f-2b0d-48fe-8af5-918c218c4c06" released by "delete_volume" :: held 1.416s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created reservations ['c117743c-84a5-4435-8f8b-30b444fcd858', '7e48eaf1-4301-400d-a989-adef443750c7', 'abf798a5-4d4d-4559-9cfa-a6b7bab70b15', '611aab62-518c-4fb8-ae64-3f2d729961f2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:52:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:52:59 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:52:59 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-3db6884b-7614-4eff-b257-d2bd9dab43b1-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-3db6884b-7614-4eff-b257-d2bd9dab43b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:00 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.652s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Deleted volume successfully. Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-3db6884b-7614-4eff-b257-d2bd9dab43b1" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-619d5155-8053-4a08-b226-e29b95f00613 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-89c5431f-2b0d-48fe-8af5-918c218c4c06-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-3db6884b-7614-4eff-b257-d2bd9dab43b1" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7837a6-94fb-4ef9-9f73-21a284c261fd]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:00 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 Jul 07 10:53:00 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:00 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1" returned: 0 in 0.736s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:00 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1 Jul 07 10:53:00 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:01 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3db6884b-7614-4eff-b257-d2bd9dab43b1" returned: 0 in 0.631s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-3db6884b-7614-4eff-b257-d2bd9dab43b1" released by "delete_volume" :: held 1.405s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created reservations ['453b7b2a-bdb4-42e6-81c5-03bab5f4a64f', '6df2310a-5328-48fe-8674-732bc0695036', '60ee8a46-f9cc-4b23-82f2-24e08ed3c6c0', 'e9a2e861-ab76-4335-98b4-a0cf6bbce27f'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:01 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:01 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-acd9db26-0ef3-46ef-96e3-ae3947982150-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-acd9db26-0ef3-46ef-96e3-ae3947982150-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:02 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:02 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Deleted volume successfully. Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-98e1c7c2-3d05-4a2b-8195-5275de3ce676 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-3db6884b-7614-4eff-b257-d2bd9dab43b1-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-acd9db26-0ef3-46ef-96e3-ae3947982150" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-acd9db26-0ef3-46ef-96e3-ae3947982150" acquired by "delete_volume" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c64116-17a9-4e6b-86c1-26e8a5642cc5]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:02 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 Jul 07 10:53:02 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:03 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150" returned: 0 in 0.737s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:03 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150 Jul 07 10:53:03 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:03 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-acd9db26-0ef3-46ef-96e3-ae3947982150" returned: 0 in 0.637s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-acd9db26-0ef3-46ef-96e3-ae3947982150" released by "delete_volume" :: held 1.409s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Created reservations ['66b28acf-c586-488f-9b56-5bda19f8ee16', '202d81b6-8039-46ad-9988-b0bfea8a205f', 'f04982ea-0d15-4f3d-b17d-1e993e688926', '35b2cd49-342e-4c09-9456-0345a0fe2fb2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:03 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:03 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:04 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.618s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Deleted volume successfully. Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-3770ed87-061c-4f13-87f6-a808f8910c31-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a89bf6f7-4dd3-4ee9-b938-9c77523f51dd tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-acd9db26-0ef3-46ef-96e3-ae3947982150-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-3770ed87-061c-4f13-87f6-a808f8910c31-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-3770ed87-061c-4f13-87f6-a808f8910c31" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-3770ed87-061c-4f13-87f6-a808f8910c31" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0067d-a15f-4abb-ab76-2498380ea471]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:04 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 Jul 07 10:53:04 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:05 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31" returned: 0 in 0.751s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:05 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31 Jul 07 10:53:05 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:06 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3770ed87-061c-4f13-87f6-a808f8910c31" returned: 0 in 0.624s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-3770ed87-061c-4f13-87f6-a808f8910c31" released by "delete_volume" :: held 1.415s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created reservations ['4ace99c5-c643-4973-ab08-0e714ed869b8', '10e7cd52-7d69-4b7b-b022-882509b0cafb', 'eb03135c-e903-4878-9d33-b9d91a77d57d', 'cea87a39-9620-4788-93cd-f17706eedd40'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:06 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:06 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-15ddaf20-c954-409c-b3fa-307037262c04-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:06 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.636s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-15ddaf20-c954-409c-b3fa-307037262c04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Deleted volume successfully. Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-15ddaf20-c954-409c-b3fa-307037262c04" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5030a44f-e8d9-49b0-a91b-73bb8803a536 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-3770ed87-061c-4f13-87f6-a808f8910c31-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-15ddaf20-c954-409c-b3fa-307037262c04" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Deleting offline snapshot 15ddaf20-c954-409c-b3fa-307037262c04 of volume ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] snapshot_file for this snap is: volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d796bb9d-0eee-4c2b-9e02-99a7835d4500]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:06 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 Jul 07 10:53:06 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:07 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04" returned: 0 in 0.725s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:07 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:53:07 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[93750565-91e4-443a-8be1-60a256821454]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:07 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 Jul 07 10:53:07 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:08 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" returned: 0 in 0.738s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:08 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 Jul 07 10:53:08 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:09 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04" returned: 0 in 0.719s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:09 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04 Jul 07 10:53:09 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:09 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4.15ddaf20-c954-409c-b3fa-307037262c04" returned: 0 in 0.668s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-15ddaf20-c954-409c-b3fa-307037262c04" released by "_delete_snapshot" :: held 2.949s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" released by "delete_snapshot" :: held 2.972s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Created reservations ['48d09b3e-56da-4bd7-b2fc-8946a36d6f69', 'a86b5b9e-5f74-46cd-8463-9f65e544e6ae', '831d1e49-dba3-449f-b6f9-40ad7bdec1ba', 'd91f23f9-a294-49f4-9891-b705969b00d3'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Delete snapshot completed successfully. Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-867ecbae-a610-48ab-9a3e-76fbac01c6a0 tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-15ddaf20-c954-409c-b3fa-307037262c04-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-ea385101-fa27-41bf-a0d3-5cfd6bde0df4-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-ea385101-fa27-41bf-a0d3-5cfd6bde0df4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "cinder-quobyte-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" acquired by "delete_volume" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:10 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9316e2f6-d043-4844-833b-ae92ccdeeee3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:10 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 Jul 07 10:53:10 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:10 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" returned: 0 in 0.741s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:10 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4 Jul 07 10:53:10 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:11 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" returned: 0 in 0.618s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-quobyte-ea385101-fa27-41bf-a0d3-5cfd6bde0df4" released by "delete_volume" :: held 1.410s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Created reservations ['b380450c-875d-4a4d-a563-a92064077705', 'a0e6c62d-6327-4426-9f2c-aa849827c333', '5e622ee2-a66a-4845-84e9-7f2d6310d38c', 'a16144dd-d819-4669-8a22-d684b3832e53'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:11 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:11 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:12 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.629s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:12 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Deleted volume successfully. Jul 07 10:53:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-477ef08e-5eb3-4fa1-b757-2c6799bb221e tempest-CreateVolumesFromSnapshotTest-38293813 None] Lock "cinder-ea385101-fa27-41bf-a0d3-5cfd6bde0df4-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Flow 'volume_create_manager' (42d9a871-0fe4-4ae0-80fb-23437076c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfef887c-1d32-4240-b759-7b339bf3f14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfef887c-1d32-4240-b759-7b339bf3f14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73677059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f6c1d2-d63a-4102-a659-a952e350b9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bd33cd2c5c4ebd87474e0bf6d635fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:15Z,use_quota=True,user_id='0d824947deaf4c68823723e04fd9f3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc492571-aaed-49ae-948c-f9841ccbc6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc492571-aaed-49ae-948c-f9841ccbc6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c354a395-9f92-4eca-90fb-6f0e214ae20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c354a395-9f92-4eca-90fb-6f0e214ae20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f6c1d2-d63a-4102-a659-a952e350b9f2', 'volume_name': 'volume-28f6c1d2-d63a-4102-a659-a952e350b9f2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223bb1d3-805d-49bc-935d-c4e7617c787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223bb1d3-805d-49bc-935d-c4e7617c787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a8f358-0adf-4c7b-b2df-7db7b7dee892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:15 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Volume 28f6c1d2-d63a-4102-a659-a952e350b9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f6c1d2-d63a-4102-a659-a952e350b9f2', 'volume_size': 1} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73677059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f6c1d2-d63a-4102-a659-a952e350b9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bd33cd2c5c4ebd87474e0bf6d635fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:15Z,use_quota=True,user_id='0d824947deaf4c68823723e04fd9f3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Creating volume 28f6c1d2-d63a-4102-a659-a952e350b9f2 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:15 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:15 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 1073741824 Jul 07 10:53:15 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:16 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 1073741824" returned: 0 in 0.789s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:16 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 Jul 07 10:53:16 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:16 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2" returned: 0 in 0.635s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a8f358-0adf-4c7b-b2df-7db7b7dee892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f6c1d2-d63a-4102-a659-a952e350b9f2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f897d6-e90f-41e2-82a1-4e48c3a122e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:16 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Volume volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 (28f6c1d2-d63a-4102-a659-a952e350b9f2): created successfully Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f897d6-e90f-41e2-82a1-4e48c3a122e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:16 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Flow 'volume_create_manager' (42d9a871-0fe4-4ae0-80fb-23437076c902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c36a2285-a3e7-4742-946a-8ea818cb872d tempest-ProjectReaderTests-599846568 None] Created volume successfully. Jul 07 10:53:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Acquiring lock "cinder-28f6c1d2-d63a-4102-a659-a952e350b9f2-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Lock "cinder-28f6c1d2-d63a-4102-a659-a952e350b9f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Acquiring lock "cinder-quobyte-28f6c1d2-d63a-4102-a659-a952e350b9f2" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Lock "cinder-quobyte-28f6c1d2-d63a-4102-a659-a952e350b9f2" acquired by "delete_volume" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:17 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d600fc-132f-4b50-a8d7-8b5fd96ba997]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:17 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 Jul 07 10:53:17 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:18 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2" returned: 0 in 0.732s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:18 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2 Jul 07 10:53:18 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:18 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-28f6c1d2-d63a-4102-a659-a952e350b9f2" returned: 0 in 0.634s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Lock "cinder-quobyte-28f6c1d2-d63a-4102-a659-a952e350b9f2" released by "delete_volume" :: held 1.404s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Created reservations ['3d926fa9-7049-4b6a-8b1c-59fedcec1c88', 'da0723f9-d78a-4b76-a854-dad29d7607b2', 'ca39bf77-2069-48a4-b233-8fb78065d509', 'bf2e45d6-2071-4ca0-8db4-efbf4ad2966e'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:19 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:19 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:19 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.635s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Deleted volume successfully. Jul 07 10:53:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-90d11c21-db0d-4a68-99ec-0b344221d258 tempest-ProjectReaderTests-599846568 None] Lock "cinder-28f6c1d2-d63a-4102-a659-a952e350b9f2-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Flow 'volume_create_manager' (be321d27-e4ee-4dd8-9fd1-7501c3faf8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe840d79-5422-483b-95cd-1f78a59d61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe840d79-5422-483b-95cd-1f78a59d61df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357196731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43428272-22b5-49c1-b1cd-10a34a3ce980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bd33cd2c5c4ebd87474e0bf6d635fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:20Z,use_quota=True,user_id='0d824947deaf4c68823723e04fd9f3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0aea5-7036-4208-9216-06a72301fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0aea5-7036-4208-9216-06a72301fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa6873a-0bfa-4d04-9fa5-abe77a443a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa6873a-0bfa-4d04-9fa5-abe77a443a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43428272-22b5-49c1-b1cd-10a34a3ce980', 'volume_name': 'volume-43428272-22b5-49c1-b1cd-10a34a3ce980', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065c3236-fa43-40c6-9990-84dfd1824538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065c3236-fa43-40c6-9990-84dfd1824538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6161535b-2a76-43e0-a12e-fa4fd4aa40cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:20 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Volume 43428272-22b5-49c1-b1cd-10a34a3ce980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43428272-22b5-49c1-b1cd-10a34a3ce980', 'volume_size': 1} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357196731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43428272-22b5-49c1-b1cd-10a34a3ce980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bd33cd2c5c4ebd87474e0bf6d635fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:20Z,use_quota=True,user_id='0d824947deaf4c68823723e04fd9f3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Creating volume 43428272-22b5-49c1-b1cd-10a34a3ce980 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:20 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:20 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 1073741824 Jul 07 10:53:20 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:20 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 1073741824" returned: 0 in 0.780s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:21 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 Jul 07 10:53:21 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:21 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980" returned: 0 in 0.630s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6161535b-2a76-43e0-a12e-fa4fd4aa40cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43428272-22b5-49c1-b1cd-10a34a3ce980', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89eb7109-4af9-4dd8-accb-9ad5d3285de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:21 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Volume volume-43428272-22b5-49c1-b1cd-10a34a3ce980 (43428272-22b5-49c1-b1cd-10a34a3ce980): created successfully Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89eb7109-4af9-4dd8-accb-9ad5d3285de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Flow 'volume_create_manager' (be321d27-e4ee-4dd8-9fd1-7501c3faf8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7804df94-821f-496d-9bbf-ba704789e7dc tempest-ProjectReaderTests-599846568 None] Created volume successfully. Jul 07 10:53:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Acquiring lock "cinder-43428272-22b5-49c1-b1cd-10a34a3ce980-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Lock "cinder-43428272-22b5-49c1-b1cd-10a34a3ce980-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Acquiring lock "cinder-quobyte-43428272-22b5-49c1-b1cd-10a34a3ce980" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Lock "cinder-quobyte-43428272-22b5-49c1-b1cd-10a34a3ce980" acquired by "delete_volume" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7290c0-eaef-4cf8-a1d6-b13646dd66c2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:22 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 Jul 07 10:53:22 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:23 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980" returned: 0 in 0.747s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:23 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980 Jul 07 10:53:23 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:23 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:23 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:23 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-43428272-22b5-49c1-b1cd-10a34a3ce980" returned: 0 in 0.629s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Lock "cinder-quobyte-43428272-22b5-49c1-b1cd-10a34a3ce980" released by "delete_volume" :: held 1.413s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Created reservations ['c70bb09a-b5e8-4554-bf3a-94a3240cc413', 'a3ff9992-2ed6-4a32-a2a6-7b3eae2ca021', 'e487df0d-c8af-48ce-ba88-2cfa22c95544', '73f8e9fc-62fa-46d6-9e63-1c505e5695cd'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=123,cinder:UPDATE=170,cinder:INSERT=50,cinder:DELETE=12 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=117,cinder:UPDATE=159,cinder:INSERT=40,cinder:DELETE=15 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:23 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:23 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:24 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.642s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:53:24 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.659s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Deleted volume successfully. Jul 07 10:53:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5221ac30-4ea1-402a-ab16-7e1cfa450ea8 tempest-ProjectReaderTests-599846568 None] Lock "cinder-43428272-22b5-49c1-b1cd-10a34a3ce980-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:34 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (d1d12b5c-72fb-48da-971b-1750b861ef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a098cece-5d5f-48ef-85ad-8194f8d15292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a098cece-5d5f-48ef-85ad-8194f8d15292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825035620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e05ee-1d6d-4460-8af4-dbfe71058e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:36Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11442bf0-4c6f-4283-a9fc-b4c1cc5f7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11442bf0-4c6f-4283-a9fc-b4c1cc5f7d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a999980-73a7-49dc-abb0-65ae1c4c45f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a999980-73a7-49dc-abb0-65ae1c4c45f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4e05ee-1d6d-4460-8af4-dbfe71058e15', 'volume_name': 'volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ec93e2-2b28-43d3-a22f-0a6a47832e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ec93e2-2b28-43d3-a22f-0a6a47832e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c92c9bb-f31b-4b9b-a5ad-322942283fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:35 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume ee4e05ee-1d6d-4460-8af4-dbfe71058e15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15', 'volume_size': 1} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825035620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e05ee-1d6d-4460-8af4-dbfe71058e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:36Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Creating volume ee4e05ee-1d6d-4460-8af4-dbfe71058e15 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:35 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:36 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 1073741824 Jul 07 10:53:36 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (6376eb0c-5d4e-4204-871d-3d8baab483af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a136a7-bcca-452a-bb9b-be73a2e84c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a136a7-bcca-452a-bb9b-be73a2e84c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890393867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf24afe-530d-42ec-9aae-64e84fd1517b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:36Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b951c6-221a-43f5-a064-433d6d2c1761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b951c6-221a-43f5-a064-433d6d2c1761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cf5631-bb89-4105-8a75-e11ad028fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cf5631-bb89-4105-8a75-e11ad028fc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf24afe-530d-42ec-9aae-64e84fd1517b', 'volume_name': 'volume-fdf24afe-530d-42ec-9aae-64e84fd1517b', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95d4b33-6c46-4a36-bb87-f8285337595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95d4b33-6c46-4a36-bb87-f8285337595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7ecfaf-4959-4e51-a8c1-331b7d48c89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume fdf24afe-530d-42ec-9aae-64e84fd1517b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf24afe-530d-42ec-9aae-64e84fd1517b', 'volume_size': 1} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (425b33bf-a2ab-417d-af06-07157641f514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43b9de5-2558-483a-9c9b-c5fd4ea9ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43b9de5-2558-483a-9c9b-c5fd4ea9ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204870878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ab3a1a-9360-4576-b148-48afb3ce1cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:37Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb3d990-d903-4639-ac7c-f5eefca23d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb3d990-d903-4639-ac7c-f5eefca23d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463e7fbe-5674-4227-9434-3acde918a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463e7fbe-5674-4227-9434-3acde918a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ab3a1a-9360-4576-b148-48afb3ce1cdc', 'volume_name': 'volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20007f5-26ed-491d-b45f-676d22813071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20007f5-26ed-491d-b45f-676d22813071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3c34ee-35dd-47b9-8238-786b511e8e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:36 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Volume d5ab3a1a-9360-4576-b148-48afb3ce1cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc', 'volume_size': 1} Jul 07 10:53:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (c86bac12-909d-43dd-852e-fbf3988cf99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3293d7a1-6990-4946-bca5-2afa40f13819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3293d7a1-6990-4946-bca5-2afa40f13819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1652726516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d5b474-4653-43fb-b91c-6b0e96782197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:37Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea2d6d4-07a0-4421-909e-484c1af6d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea2d6d4-07a0-4421-909e-484c1af6d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdb7183-9702-470d-b0b0-8f07bfc249e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdb7183-9702-470d-b0b0-8f07bfc249e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d5b474-4653-43fb-b91c-6b0e96782197', 'volume_name': 'volume-a2d5b474-4653-43fb-b91c-6b0e96782197', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6a3099-be8e-42a0-a047-6d86f9475fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6a3099-be8e-42a0-a047-6d86f9475fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301108c9-40f8-4a60-9f7c-af6afdd7b2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Volume a2d5b474-4653-43fb-b91c-6b0e96782197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d5b474-4653-43fb-b91c-6b0e96782197', 'volume_size': 1} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 1073741824" returned: 0 in 1.123s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:37 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 Jul 07 10:53:37 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (7f7f1957-338e-47c2-97ac-c31ece2a5228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c31c92-61ba-46c7-b1d7-6b2c09f28596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c31c92-61ba-46c7-b1d7-6b2c09f28596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1995747170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727a07f2-29dd-4f8b-8af0-b10ef80a02e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:37Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a504a58-888d-4f3e-bd17-0b9954e4b700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a504a58-888d-4f3e-bd17-0b9954e4b700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a043c1b6-436f-449d-b40d-53438a45a21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a043c1b6-436f-449d-b40d-53438a45a21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727a07f2-29dd-4f8b-8af0-b10ef80a02e2', 'volume_name': 'volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7455f046-3dd1-4a30-b5ec-ce8fbde8c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7455f046-3dd1-4a30-b5ec-ce8fbde8c60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6064c621-1b09-4798-b10d-a8a4f7f8df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Volume 727a07f2-29dd-4f8b-8af0-b10ef80a02e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2', 'volume_size': 1} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (cc791f8b-b804-44a5-a5d2-698783d66a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4869e43-02d6-4457-b6f3-f24cf338fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4869e43-02d6-4457-b6f3-f24cf338fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1442806359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b4fb40-21c6-4384-83a8-79637ac1ce8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:38Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a26ee8-71bb-4ef7-8fe4-4d0690613f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a26ee8-71bb-4ef7-8fe4-4d0690613f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec725f25-94f2-49e1-a43b-0a8e46e47671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec725f25-94f2-49e1-a43b-0a8e46e47671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b4fb40-21c6-4384-83a8-79637ac1ce8d', 'volume_name': 'volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc705f54-3019-40e7-990f-d79cb42fe304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc705f54-3019-40e7-990f-d79cb42fe304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa325266-dfb8-4f69-8ada-6b4a8696c855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:37 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Volume 99b4fb40-21c6-4384-83a8-79637ac1ce8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d', 'volume_size': 1} Jul 07 10:53:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:38 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15" returned: 0 in 0.901s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890393867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf24afe-530d-42ec-9aae-64e84fd1517b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:36Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Creating volume fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:38 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c92c9bb-f31b-4b9b-a5ad-322942283fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:38 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b 1073741824 Jul 07 10:53:38 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a2d1ce-7abb-4ea8-9c81-252a93c4dab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 (ee4e05ee-1d6d-4460-8af4-dbfe71058e15): created successfully Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a2d1ce-7abb-4ea8-9c81-252a93c4dab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (d1d12b5c-72fb-48da-971b-1750b861ef4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f4e6b5c7-7ac4-41c0-be39-3b34047dafce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created volume successfully. Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (5d018171-60c6-44b9-94cf-aa778743ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1c2f6c-187b-4b75-886e-1159c5fcc035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1c2f6c-187b-4b75-886e-1159c5fcc035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1706063605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69df64fc-1ce5-426d-81c8-b8cd47f16992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:38Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0a8694-7bc6-4a9f-9b0c-ce14ecc9614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0a8694-7bc6-4a9f-9b0c-ce14ecc9614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b34bdc5-7aef-462f-a92e-f3db28d99573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b34bdc5-7aef-462f-a92e-f3db28d99573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69df64fc-1ce5-426d-81c8-b8cd47f16992', 'volume_name': 'volume-69df64fc-1ce5-426d-81c8-b8cd47f16992', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414d09a7-7ed8-438a-b02d-27fe0e53e9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414d09a7-7ed8-438a-b02d-27fe0e53e9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c3e2a6-ddb6-4445-ba3b-26a1fa708215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Volume 69df64fc-1ce5-426d-81c8-b8cd47f16992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69df64fc-1ce5-426d-81c8-b8cd47f16992', 'volume_size': 1} Jul 07 10:53:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:39 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b 1073741824" returned: 0 in 0.928s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:39 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b Jul 07 10:53:39 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (3a9308d2-c649-4214-b588-1072ac0ba02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794999d2-1b5d-4168-b647-0bd7c3509ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794999d2-1b5d-4168-b647-0bd7c3509ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321313402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeb46a4-be5f-4a84-bce7-19384878cc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:40Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6119f39-6ab8-4052-ae24-9fa634071a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6119f39-6ab8-4052-ae24-9fa634071a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af78d632-a41d-4bf7-8a13-80048fb3d5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af78d632-a41d-4bf7-8a13-80048fb3d5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aeb46a4-be5f-4a84-bce7-19384878cc17', 'volume_name': 'volume-2aeb46a4-be5f-4a84-bce7-19384878cc17', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e75c472-f0be-4311-b0c3-7d1a05608303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e75c472-f0be-4311-b0c3-7d1a05608303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e512f2-2b54-4ff0-a3e5-1ab8cb577e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:39 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume 2aeb46a4-be5f-4a84-bce7-19384878cc17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aeb46a4-be5f-4a84-bce7-19384878cc17', 'volume_size': 1} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:39 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b" returned: 0 in 0.835s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.250s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204870878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ab3a1a-9360-4576-b148-48afb3ce1cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:37Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Creating volume d5ab3a1a-9360-4576-b148-48afb3ce1cdc {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:39 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7ecfaf-4959-4e51-a8c1-331b7d48c89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf24afe-530d-42ec-9aae-64e84fd1517b', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f83ffe-3ed3-4ab5-9d6d-1c78aae678cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:39 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc 1073741824 Jul 07 10:53:39 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:39 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume volume-fdf24afe-530d-42ec-9aae-64e84fd1517b (fdf24afe-530d-42ec-9aae-64e84fd1517b): created successfully Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f83ffe-3ed3-4ab5-9d6d-1c78aae678cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:39 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (6376eb0c-5d4e-4204-871d-3d8baab483af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:39 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9499c74c-dc28-46fa-980d-680246380db6 tempest-CreateVolumesFromSnapshotTest-382660073 None] Created volume successfully. Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (d4abcebb-8a22-47b1-9d3b-24eaa2ffd665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be96d05e-19b1-4d52-99f3-58b7ba88ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be96d05e-19b1-4d52-99f3-58b7ba88ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480798849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f94b4d-e728-40b4-b036-66aa96c46b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:40Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda6c8f5-c66b-4cdd-b02e-97300d89bf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda6c8f5-c66b-4cdd-b02e-97300d89bf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60954296-5124-412f-b57c-b05c51a250f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60954296-5124-412f-b57c-b05c51a250f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f94b4d-e728-40b4-b036-66aa96c46b99', 'volume_name': 'volume-33f94b4d-e728-40b4-b036-66aa96c46b99', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360af277-730c-49db-adab-a7a0a593cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360af277-730c-49db-adab-a7a0a593cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef85aeb7-8ce9-4965-a883-7df4614757c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume 33f94b4d-e728-40b4-b036-66aa96c46b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f94b4d-e728-40b4-b036-66aa96c46b99', 'volume_size': 1} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Flow 'volume_create_manager' (5a34b0cf-52c9-4100-93a8-eb743d529b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc30f1f-e9c9-4c07-b8cb-39596d8e89fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc30f1f-e9c9-4c07-b8cb-39596d8e89fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6303e0-976e-4a7f-96b1-30c5e5ba716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9f592c07e54c2b9178b6548f4aaeeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:40Z,use_quota=True,user_id='5ff15c47255e4a609be966c032c87880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e7f13d-4f4a-4175-b6c8-fb1f428dcf9f),volume_type_id=05e7f13d-4f4a-4175-b6c8-fb1f428dcf9f)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b39ef4-d1fe-4b98-a312-9b2495d3c75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b39ef4-d1fe-4b98-a312-9b2495d3c75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbc58e2-f312-41d8-b31f-38aa817f954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbc58e2-f312-41d8-b31f-38aa817f954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d6303e0-976e-4a7f-96b1-30c5e5ba716a', 'volume_name': 'volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a', 'volume_size': 1, 'image_id': '46a0347e-ecde-4bf7-96ed-3c5c08359641', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46a0347e-ecde-4bf7-96ed-3c5c08359641', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9868b49ddfd80492e095f49a2b21a170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb9f592c07e54c2b9178b6548f4aaeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e67447e81a0797c12de7d246bc91057f0941fa1af85d6db8b058a37a1ab38838ec039dda0ea4f9a52fc40d4eccbf03e8385ae81be6851da5ecd3306d4f51ec1', 'id': '46a0347e-ecde-4bf7-96ed-3c5c08359641', 'created_at': datetime.datetime(2026, 7, 7, 8, 53, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 53, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46a0347e-ecde-4bf7-96ed-3c5c08359641/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1890ffaf-a3f0-484f-a125-59a2ad0cafb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1890ffaf-a3f0-484f-a125-59a2ad0cafb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e1a835-d92b-497b-b23c-dfec7ad35bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Volume 6d6303e0-976e-4a7f-96b1-30c5e5ba716a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a', 'volume_size': 1, 'image_id': '46a0347e-ecde-4bf7-96ed-3c5c08359641', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46a0347e-ecde-4bf7-96ed-3c5c08359641', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9868b49ddfd80492e095f49a2b21a170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb9f592c07e54c2b9178b6548f4aaeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e67447e81a0797c12de7d246bc91057f0941fa1af85d6db8b058a37a1ab38838ec039dda0ea4f9a52fc40d4eccbf03e8385ae81be6851da5ecd3306d4f51ec1', 'id': '46a0347e-ecde-4bf7-96ed-3c5c08359641', 'created_at': datetime.datetime(2026, 7, 7, 8, 53, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 53, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46a0347e-ecde-4bf7-96ed-3c5c08359641/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Trying to clone 6d6303e0-976e-4a7f-96b1-30c5e5ba716a from image 46a0347e-ecde-4bf7-96ed-3c5c08359641 at location (None, [{'url': 'file:///opt/stack/data/glance/images/46a0347e-ecde-4bf7-96ed-3c5c08359641', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (e79ba759-d228-4421-a933-1d8af46ccd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e077b498-305c-4b02-9641-223ad3ec8e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e077b498-305c-4b02-9641-223ad3ec8e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419393101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d99a4b-5a5e-438c-9708-8e09d87d4106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:41Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf7328c-14f5-4fde-a24d-ab15c764a726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf7328c-14f5-4fde-a24d-ab15c764a726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b1dd1b-98fc-4e8e-872f-c223cab5ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b1dd1b-98fc-4e8e-872f-c223cab5ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d99a4b-5a5e-438c-9708-8e09d87d4106', 'volume_name': 'volume-60d99a4b-5a5e-438c-9708-8e09d87d4106', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a7d7f3-2751-43f9-9ff1-603420398863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a7d7f3-2751-43f9-9ff1-603420398863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43598dc-c2a6-446b-b1ae-17b85b8578ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume 60d99a4b-5a5e-438c-9708-8e09d87d4106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d99a4b-5a5e-438c-9708-8e09d87d4106', 'volume_size': 1} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:53:40 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Image download 0.00 MB at 0.00 MB/s Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae40f21a-3b27-4cfb-8399-93d3e9ba4c65]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:41 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD Jul 07 10:53:41 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:41 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc 1073741824" returned: 0 in 1.217s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:41 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc Jul 07 10:53:41 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (832cf093-2f2b-433e-a9cc-24e1efe1440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b44ecbe-1570-45e5-8abe-bb837f4edd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b44ecbe-1570-45e5-8abe-bb837f4edd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301986776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294872d8-9eef-4df5-a37e-6f7bf6b3f1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:41Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebda77c-4267-4b04-963c-6e1140357027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebda77c-4267-4b04-963c-6e1140357027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffebcd0-e31d-4d0b-a200-a669f24b3f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffebcd0-e31d-4d0b-a200-a669f24b3f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294872d8-9eef-4df5-a37e-6f7bf6b3f1a6', 'volume_name': 'volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1f080f-be71-4cc8-9bb1-03e2c320c74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1f080f-be71-4cc8-9bb1-03e2c320c74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b63551-c720-4c43-843f-0861b79827fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume 294872d8-9eef-4df5-a37e-6f7bf6b3f1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6', 'volume_size': 1} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (fa6e884b-06c4-4471-aec3-c73aeb5a7fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3786868e-e6a7-4013-9fd1-0520bff08e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3786868e-e6a7-4013-9fd1-0520bff08e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818073617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:42Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279adb0a-5479-4587-b293-48392c058514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279adb0a-5479-4587-b293-48392c058514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b9e4bd-15e6-49de-b2bd-01a47cad4930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b9e4bd-15e6-49de-b2bd-01a47cad4930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20', 'volume_name': 'volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2675d45-dd22-48e5-8df1-23f7750e2cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2675d45-dd22-48e5-8df1-23f7750e2cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4933a57a-a833-43df-95d9-4afa4625a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume 6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20', 'volume_size': 1} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:41 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD" returned: 0 in 0.867s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:41 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc" returned: 0 in 0.753s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.831s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1652726516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d5b474-4653-43fb-b91c-6b0e96782197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:37Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Creating volume a2d5b474-4653-43fb-b91c-6b0e96782197 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:41 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:41 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD Jul 07 10:53:41 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:41 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 1073741824 Jul 07 10:53:41 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3c34ee-35dd-47b9-8238-786b511e8e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dec1be-8646-437f-8d84-99288ae9b824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:42 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Volume volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc (d5ab3a1a-9360-4576-b148-48afb3ce1cdc): created successfully Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dec1be-8646-437f-8d84-99288ae9b824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (425b33bf-a2ab-417d-af06-07157641f514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f5a6774c-d370-4941-867c-8d4a20ce203a tempest-CreateVolumesFromImageTest-1494748551 None] Created volume successfully. Jul 07 10:53:42 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD" returned: 1 in 0.789s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Temporary image 46a0347e-ecde-4bf7-96ed-3c5c08359641 is fetched for user 5ff15c47255e4a609be966c032c87880. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f577599b-ff59-4b85-af60-4c392aa03871]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:42 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD Jul 07 10:53:42 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:42 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 1073741824" returned: 0 in 0.874s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:42 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 Jul 07 10:53:42 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:43 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:43 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197" returned: 0 in 0.674s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.063s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:43 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1995747170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727a07f2-29dd-4f8b-8af0-b10ef80a02e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:37Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:43 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Creating volume 727a07f2-29dd-4f8b-8af0-b10ef80a02e2 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:43 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301108c9-40f8-4a60-9f7c-af6afdd7b2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d5b474-4653-43fb-b91c-6b0e96782197', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bfdbc7-ad8a-4790-a650-e46a66479fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:43 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 1073741824 Jul 07 10:53:43 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Volume volume-a2d5b474-4653-43fb-b91c-6b0e96782197 (a2d5b474-4653-43fb-b91c-6b0e96782197): created successfully Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bfdbc7-ad8a-4790-a650-e46a66479fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (c86bac12-909d-43dd-852e-fbf3988cf99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5b382fea-6045-41b3-ba2a-4ef5209f07f5 tempest-CreateVolumesFromImageTest-1494748551 None] Created volume successfully. Jul 07 10:53:44 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD" returned: 1 in 0.749s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:53:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:44 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 1073741824" returned: 0 in 0.854s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:44 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 Jul 07 10:53:44 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:45 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2" returned: 0 in 0.655s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.225s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1442806359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b4fb40-21c6-4384-83a8-79637ac1ce8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:38Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Creating volume 99b4fb40-21c6-4384-83a8-79637ac1ce8d {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:45 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6064c621-1b09-4798-b10d-a8a4f7f8df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:45 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d 1073741824 Jul 07 10:53:45 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c0a392-7bf0-4abf-a0f5-53b66cd73a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:45 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Volume volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 (727a07f2-29dd-4f8b-8af0-b10ef80a02e2): created successfully Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c0a392-7bf0-4abf-a0f5-53b66cd73a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (7f7f1957-338e-47c2-97ac-c31ece2a5228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4730d546-9afd-4522-ac1c-2b87d75ceb02 tempest-CreateVolumesFromImageTest-1494748551 None] Created volume successfully. Jul 07 10:53:45 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d 1073741824" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:46 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d Jul 07 10:53:46 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:46 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d" returned: 0 in 0.637s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.344s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1706063605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69df64fc-1ce5-426d-81c8-b8cd47f16992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287cddea68ab43fa9ec6e421567c4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:38Z,use_quota=True,user_id='39b533de98cd4b27af4bbf2afa1d894a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Creating volume 69df64fc-1ce5-426d-81c8-b8cd47f16992 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:46 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:46 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 1073741824 Jul 07 10:53:46 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa325266-dfb8-4f69-8ada-6b4a8696c855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c70da4-d793-4932-b5f9-1066337d1eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:46 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Volume volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d (99b4fb40-21c6-4384-83a8-79637ac1ce8d): created successfully Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c70da4-d793-4932-b5f9-1066337d1eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:46 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (cc791f8b-b804-44a5-a5d2-698783d66a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:46 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5887c0e9-bbb6-492e-8ca8-66da3181324c tempest-CreateVolumesFromImageTest-1494748551 None] Created volume successfully. Jul 07 10:53:47 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 1073741824" returned: 0 in 0.808s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:47 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 Jul 07 10:53:47 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:48 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992" returned: 0 in 0.626s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.408s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321313402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeb46a4-be5f-4a84-bce7-19384878cc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:40Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Creating volume 2aeb46a4-be5f-4a84-bce7-19384878cc17 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:48 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:48 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 1073741824 Jul 07 10:53:48 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c3e2a6-ddb6-4445-ba3b-26a1fa708215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69df64fc-1ce5-426d-81c8-b8cd47f16992', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f0f610-4b7c-4763-97b9-09866ffca58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:48 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Volume volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 (69df64fc-1ce5-426d-81c8-b8cd47f16992): created successfully Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f0f610-4b7c-4763-97b9-09866ffca58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Flow 'volume_create_manager' (5d018171-60c6-44b9-94cf-aa778743ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1f1a8d7e-76aa-4c3b-bdf7-29349917a36c tempest-CreateVolumesFromImageTest-1494748551 None] Created volume successfully. Jul 07 10:53:48 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 1073741824" returned: 0 in 0.787s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:48 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 Jul 07 10:53:48 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-69df64fc-1ce5-426d-81c8-b8cd47f16992-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-69df64fc-1ce5-426d-81c8-b8cd47f16992-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-quobyte-69df64fc-1ce5-426d-81c8-b8cd47f16992" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-69df64fc-1ce5-426d-81c8-b8cd47f16992" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[19561b0e-9a11-4cfb-8e1e-820ec98185cf]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:49 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 Jul 07 10:53:49 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:49 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17" returned: 0 in 0.655s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.354s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480798849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f94b4d-e728-40b4-b036-66aa96c46b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:40Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Creating volume 33f94b4d-e728-40b4-b036-66aa96c46b99 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:49 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e512f2-2b54-4ff0-a3e5-1ab8cb577e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aeb46a4-be5f-4a84-bce7-19384878cc17', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d8e850-39f8-4c25-aedb-f4b655f6a06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:49 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 1073741824 Jul 07 10:53:49 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:49 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 (2aeb46a4-be5f-4a84-bce7-19384878cc17): created successfully Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d8e850-39f8-4c25-aedb-f4b655f6a06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (3a9308d2-c649-4214-b588-1072ac0ba02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c6d2a527-a75f-4eb5-990c-100ecdfa4fe0 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created volume successfully. Jul 07 10:53:50 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992" returned: 0 in 0.795s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:50 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992 Jul 07 10:53:50 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:50 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 1073741824" returned: 0 in 0.841s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:50 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 Jul 07 10:53:50 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:50 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-69df64fc-1ce5-426d-81c8-b8cd47f16992" returned: 0 in 0.664s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-69df64fc-1ce5-426d-81c8-b8cd47f16992" released by "delete_volume" :: held 1.499s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Created reservations ['d7e06959-d8e0-4865-9b11-e35e517af4cc', '7488eb24-f4e0-4320-9e44-7e16c096df8e', '76d00bdf-268e-427b-a91e-c29ed22cd690', '94028248-e18a-41a6-b5b3-693c6abb2267'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:50 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:50 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:51 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99" returned: 0 in 0.652s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.363s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Creating offline snapshot 550c8c62-e460-484b-bea6-a62e785fa345 of volume fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef85aeb7-8ce9-4965-a883-7df4614757c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f94b4d-e728-40b4-b036-66aa96c46b99', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9288b83-54ca-4cbb-92d8-ff67125eff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71bab5c-42a1-4e50-8e85-1b8a723dffc8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:51 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume volume-33f94b4d-e728-40b4-b036-66aa96c46b99 (33f94b4d-e728-40b4-b036-66aa96c46b99): created successfully Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9288b83-54ca-4cbb-92d8-ff67125eff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (d4abcebb-8a22-47b1-9d3b-24eaa2ffd665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-48b77d1d-477d-415d-9088-1d9ab142b5ce tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created volume successfully. Jul 07 10:53:51 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b Jul 07 10:53:51 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-99b4fb40-21c6-4384-83a8-79637ac1ce8d-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-99b4fb40-21c6-4384-83a8-79637ac1ce8d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-quobyte-99b4fb40-21c6-4384-83a8-79637ac1ce8d" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-99b4fb40-21c6-4384-83a8-79637ac1ce8d" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3220ba4-27b5-405d-a3f1-bfa90a84beb8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:51 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.747s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Deleted volume successfully. Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-efbe3c81-fa26-43cf-99e4-f1e3d096b67b tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-69df64fc-1ce5-426d-81c8-b8cd47f16992-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:51 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d Jul 07 10:53:51 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:51 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:52 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 1G Jul 07 10:53:52 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:52 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d" returned: 0 in 0.794s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:52 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d Jul 07 10:53:52 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:52 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 1G" returned: 0 in 0.841s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf24afe-530d-42ec-9aae-64e84fd1517b -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:52 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf24afe-530d-42ec-9aae-64e84fd1517b -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 Jul 07 10:53:52 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:53 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-99b4fb40-21c6-4384-83a8-79637ac1ce8d" returned: 0 in 0.644s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-99b4fb40-21c6-4384-83a8-79637ac1ce8d" released by "delete_volume" :: held 1.495s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Created reservations ['c62020ea-ad3f-4a51-986d-480a0fe9d3de', '39f8d4df-f62b-4f11-9698-15c0ef0191f8', '17c6cc53-8530-41ab-9954-f7d063b30aa1', '6acfd6bd-70d2-4045-8b35-026d33daeaab'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:53 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:53 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:53 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf24afe-530d-42ec-9aae-64e84fd1517b -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345" returned: 0 in 0.722s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:53 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 is being set with open permissions: ugo+rw Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:53 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 Jul 07 10:53:53 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-727a07f2-29dd-4f8b-8af0-b10ef80a02e2-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-727a07f2-29dd-4f8b-8af0-b10ef80a02e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-quobyte-727a07f2-29dd-4f8b-8af0-b10ef80a02e2" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-727a07f2-29dd-4f8b-8af0-b10ef80a02e2" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2630f-9595-4ceb-b515-962fb3006617]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:53 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Deleted volume successfully. Jul 07 10:53:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-410dce02-292d-4d8e-9ebb-27bf4cc40e25 tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-99b4fb40-21c6-4384-83a8-79637ac1ce8d-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:53 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 Jul 07 10:53:53 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:54 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:54 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.info Jul 07 10:53:54 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:54 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2" returned: 0 in 0.792s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:54 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2 Jul 07 10:53:54 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:54 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.info" returned: 0 in 0.707s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:54 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.info is being set with open permissions: ugo+rw Jul 07 10:53:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:55 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.info Jul 07 10:53:55 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:55 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-727a07f2-29dd-4f8b-8af0-b10ef80a02e2" returned: 0 in 0.638s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-727a07f2-29dd-4f8b-8af0-b10ef80a02e2" released by "delete_volume" :: held 1.488s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Created reservations ['0b5d67dd-8099-4edf-97de-46ae6b9fc029', 'de420fee-7800-4e82-b296-98b26e23c92b', '50ba8a30-ea70-4f7b-93ee-5f481682ef17', '44cc2785-64f0-4732-a824-41a1da6e3e6b'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:55 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:55 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:55 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.info" returned: 0 in 0.647s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.479s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.742s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419393101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d99a4b-5a5e-438c-9708-8e09d87d4106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:41Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Creating volume 60d99a4b-5a5e-438c-9708-8e09d87d4106 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:55 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:55 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 1073741824 Jul 07 10:53:55 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-30b81fe8-df89-47e8-9b9a-902deb5985d0 tempest-CreateVolumesFromSnapshotTest-382660073 None] Create snapshot completed successfully Jul 07 10:53:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-a2d5b474-4653-43fb-b91c-6b0e96782197-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-a2d5b474-4653-43fb-b91c-6b0e96782197-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-quobyte-a2d5b474-4653-43fb-b91c-6b0e96782197" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-a2d5b474-4653-43fb-b91c-6b0e96782197" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:56 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.677s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Deleted volume successfully. Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f0a8e4-0b97-480c-b5fd-dc9a7fb06fec]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-14a2895b-02eb-4193-b962-bb382bc4618f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-727a07f2-29dd-4f8b-8af0-b10ef80a02e2-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:56 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 Jul 07 10:53:56 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:56 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 1073741824" returned: 0 in 0.857s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:56 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 Jul 07 10:53:56 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (34ed386d-8594-46e4-bcfe-9be7f65aca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d0198a-56e2-4a4f-9f2c-4c7afafc1196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d0198a-56e2-4a4f-9f2c-4c7afafc1196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1765715535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81816ae4-7db4-462a-9808-7d3b920ea450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:57Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e300f0-c789-4ed7-90a5-cd84582623b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e300f0-c789-4ed7-90a5-cd84582623b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66171319-380b-4049-b372-5fe67b2c1fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:56 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66171319-380b-4049-b372-5fe67b2c1fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81816ae4-7db4-462a-9808-7d3b920ea450', 'volume_name': 'volume-81816ae4-7db4-462a-9808-7d3b920ea450', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a0c5f4-f71c-4945-ae7d-a117fe997d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a0c5f4-f71c-4945-ae7d-a117fe997d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ae0c02-39cb-442c-9776-1962f8ac783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:56 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume 81816ae4-7db4-462a-9808-7d3b920ea450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81816ae4-7db4-462a-9808-7d3b920ea450', 'volume_size': 1} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197" returned: 0 in 0.835s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:56 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197 Jul 07 10:53:56 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (4726730f-0938-4668-9726-41df095c6d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8aac9a-5b65-4081-ac61-c9ac82aecc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8aac9a-5b65-4081-ac61-c9ac82aecc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109830173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04e241b-8061-4be3-b8bc-4ac840df87e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:57Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd142b11-d76f-4761-8660-e3e688493a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd142b11-d76f-4761-8660-e3e688493a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce17b7-e76b-4e08-b353-c85f5e26370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce17b7-e76b-4e08-b353-c85f5e26370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04e241b-8061-4be3-b8bc-4ac840df87e4', 'volume_name': 'volume-d04e241b-8061-4be3-b8bc-4ac840df87e4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9871a6-4e39-4ac0-b0cb-100a956de0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9871a6-4e39-4ac0-b0cb-100a956de0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95674bba-480d-44e1-8314-0e9b70736c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume d04e241b-8061-4be3-b8bc-4ac840df87e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04e241b-8061-4be3-b8bc-4ac840df87e4', 'volume_size': 1} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:57 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106" returned: 0 in 0.931s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.203s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301986776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294872d8-9eef-4df5-a37e-6f7bf6b3f1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:41Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Creating volume 294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:57 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43598dc-c2a6-446b-b1ae-17b85b8578ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d99a4b-5a5e-438c-9708-8e09d87d4106', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 1073741824 Jul 07 10:53:57 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f38220d-0243-40d7-a3ee-fb6ec3156f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 (60d99a4b-5a5e-438c-9708-8e09d87d4106): created successfully Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f38220d-0243-40d7-a3ee-fb6ec3156f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (e79ba759-d228-4421-a933-1d8af46ccd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:57 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4444ab98-beaf-4f45-a83d-8ba7c2afae3b tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created volume successfully. Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (01ea4ddc-5aed-4232-bf19-576b2023b942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180ce88d-ce53-4261-92fd-1db22baa73c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180ce88d-ce53-4261-92fd-1db22baa73c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16765995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:58Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7d82c8-e99a-46a3-a64f-5b28dfee2846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7d82c8-e99a-46a3-a64f-5b28dfee2846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522f28ef-f2c7-49fd-bb5c-a08168d49866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522f28ef-f2c7-49fd-bb5c-a08168d49866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8', 'volume_name': 'volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a0a9ff-90fc-4214-9a8d-c9818eee64f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a0a9ff-90fc-4214-9a8d-c9818eee64f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a7bcc2-1042-4f6f-a5dd-382e0518b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:57 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8', 'volume_size': 1} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a2d5b474-4653-43fb-b91c-6b0e96782197" returned: 0 in 0.858s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-a2d5b474-4653-43fb-b91c-6b0e96782197" released by "delete_volume" :: held 1.749s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Created reservations ['cc4659fd-452a-4d04-b348-88f500fda6c6', '765302fc-6845-4b11-8605-cfccc96b305d', 'ff4189b7-2887-4c70-ae85-070acb573f67', 'cfa253fe-a878-417b-9212-ae70dfc1ddcc'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:58 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:53:58 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (9cfd79ea-d30f-43b0-9071-4d6295980387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5b8d9d-4b26-4cb8-bdfb-7ed0f1a14523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5b8d9d-4b26-4cb8-bdfb-7ed0f1a14523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850850230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6416e4ec-da8e-47c2-90f5-77346a7a0208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:58Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2006d51e-ef87-4708-8c79-cc2ca21acefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2006d51e-ef87-4708-8c79-cc2ca21acefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50f407c-2496-433a-8aaa-fa2831c1fff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50f407c-2496-433a-8aaa-fa2831c1fff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6416e4ec-da8e-47c2-90f5-77346a7a0208', 'volume_name': 'volume-6416e4ec-da8e-47c2-90f5-77346a7a0208', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df8596-cc86-4bbd-8890-64a0d8e813eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df8596-cc86-4bbd-8890-64a0d8e813eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d5bb85-a9c3-4c9d-8351-b1a2b8124774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume 6416e4ec-da8e-47c2-90f5-77346a7a0208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6416e4ec-da8e-47c2-90f5-77346a7a0208', 'volume_size': 1} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-d5ab3a1a-9360-4576-b148-48afb3ce1cdc-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-d5ab3a1a-9360-4576-b148-48afb3ce1cdc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "cinder-quobyte-d5ab3a1a-9360-4576-b148-48afb3ce1cdc" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-d5ab3a1a-9360-4576-b148-48afb3ce1cdc" acquired by "delete_volume" :: waited 0.033s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4a5e23-8225-4583-8e76-adf856b45e90]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:58 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 1073741824" returned: 0 in 1.111s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:58 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc Jul 07 10:53:58 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (c8271376-d9cf-46d0-b35e-221f90f700f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f9e004-59e9-4aa8-b1a7-8ca6ffbd4581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f9e004-59e9-4aa8-b1a7-8ca6ffbd4581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628764896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:59Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 Jul 07 10:53:58 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848213b0-a7bb-45b9-a7bb-c38a837ce65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848213b0-a7bb-45b9-a7bb-c38a837ce65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb45aa7f-b1ac-472b-8e24-4a940408a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb45aa7f-b1ac-472b-8e24-4a940408a86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb', 'volume_name': 'volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422da87a-92b6-41b9-87f2-33dbc22ce85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422da87a-92b6-41b9-87f2-33dbc22ce85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01ae0e3-8a6d-475d-a1d6-6b73168ba57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:58 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume 15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb', 'volume_size': 1} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:58 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.830s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:53:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Deleted volume successfully. Jul 07 10:53:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fb4e01f7-bde1-4ba5-b2c9-e2d7e4da1e3f tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-a2d5b474-4653-43fb-b91c-6b0e96782197-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:53:59 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc" returned: 0 in 0.835s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:59 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc Jul 07 10:53:59 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:59 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6" returned: 0 in 0.680s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.726s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818073617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea03f22cec437ea92a588081c7feda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:42Z,use_quota=True,user_id='8f93f97f78704ae7b2ab5266627ac329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Creating volume 6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:53:59 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b63551-c720-4c43-843f-0861b79827fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:59 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 1073741824 Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004e3e96-fe82-4782-8ba3-271e31348937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:53:59 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:53:59 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 (294872d8-9eef-4df5-a37e-6f7bf6b3f1a6): created successfully Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004e3e96-fe82-4782-8ba3-271e31348937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:53:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (832cf093-2f2b-433e-a9cc-24e1efe1440d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:53:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ac86566c-bd48-4179-afc9-75e29627b188 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created volume successfully. Jul 07 10:54:00 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d5ab3a1a-9360-4576-b148-48afb3ce1cdc" returned: 0 in 0.660s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-quobyte-d5ab3a1a-9360-4576-b148-48afb3ce1cdc" released by "delete_volume" :: held 1.552s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Created reservations ['d4507337-a779-4cf1-ac91-6fd61cd5b496', 'e1a1e003-beca-4491-9467-3ef589d2b3c8', '9ab33c0d-f7ed-40de-9c1a-d404b78dc8d1', '55296702-d9ff-44f7-adf0-dc9fd5e3bcba'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:00 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:00 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:00 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 1073741824" returned: 0 in 0.903s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:00 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 Jul 07 10:54:00 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:00 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.701s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Deleted volume successfully. Jul 07 10:54:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-409c5eff-4c3a-4189-8b92-086543d13d5a tempest-CreateVolumesFromImageTest-1494748551 None] Lock "cinder-d5ab3a1a-9360-4576-b148-48afb3ce1cdc-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:01 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20" returned: 0 in 0.675s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.851s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6303e0-976e-4a7f-96b1-30c5e5ba716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9f592c07e54c2b9178b6548f4aaeeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:40Z,use_quota=True,user_id='5ff15c47255e4a609be966c032c87880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e7f13d-4f4a-4175-b6c8-fb1f428dcf9f),volume_type_id=05e7f13d-4f4a-4175-b6c8-fb1f428dcf9f)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Creating volume 6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:01 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4933a57a-a833-43df-95d9-4afa4625a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ceb276-2847-4525-b98c-dc223f29211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:01 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a 1073741824 Jul 07 10:54:01 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:01 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Volume volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 (6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20): created successfully Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ceb276-2847-4525-b98c-dc223f29211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Flow 'volume_create_manager' (fa6e884b-06c4-4471-aec3-c73aeb5a7fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:01 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-345c838a-e307-4492-8b63-a27fed4d1182 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created volume successfully. Jul 07 10:54:01 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a 1073741824" returned: 0 in 0.915s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:02 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a Jul 07 10:54:02 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-quobyte-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7589ef-f8d0-4ef2-ae19-834af193b825]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:02 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 Jul 07 10:54:02 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:02 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" returned: 0 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.792s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1765715535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81816ae4-7db4-462a-9808-7d3b920ea450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:57Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Creating volume 81816ae4-7db4-462a-9808-7d3b920ea450 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:02 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:02 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 1073741824 Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Attempting download of 46a0347e-ecde-4bf7-96ed-3c5c08359641 ((None, [{'url': 'file:///opt/stack/data/glance/images/46a0347e-ecde-4bf7-96ed-3c5c08359641', 'metadata': {}}])) to volume 6d6303e0-976e-4a7f-96b1-30c5e5ba716a. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:54:02 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76854e5-d280-4fa7-b909-588b5ff5edb2]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46a0347e-ecde-4bf7-96ed-3c5c08359641_0iz8hj0t {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:03 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46a0347e-ecde-4bf7-96ed-3c5c08359641_0iz8hj0t Jul 07 10:54:03 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:03 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20" returned: 0 in 0.869s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:03 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20 Jul 07 10:54:03 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:03 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46a0347e-ecde-4bf7-96ed-3c5c08359641_0iz8hj0t" returned: 0 in 0.814s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a0347e-ecde-4bf7-96ed-3c5c08359641_0iz8hj0t {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:03 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 1073741824" returned: 0 in 1.017s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:03 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a0347e-ecde-4bf7-96ed-3c5c08359641_0iz8hj0t Jul 07 10:54:03 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:03 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 Jul 07 10:54:03 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:04 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20" returned: 0 in 0.800s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20" released by "delete_volume" :: held 1.722s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created reservations ['197f3af9-0bf1-40ca-8325-1e0e80a8af67', '1f171ff3-bca5-47af-aee0-4a64757c6d78', '7db97ba7-a261-47d4-a1b8-b6a735eb30c1', '99b00f46-372c-462d-a5bf-acd3424d7160'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:04 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:04 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:04 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a0347e-ecde-4bf7-96ed-3c5c08359641_0iz8hj0t" returned: 1 in 0.905s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a0347e-ecde-4bf7-96ed-3c5c08359641_0iz8hj0t' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed1c0e2-21b8-4c91-9883-5b3c5a920b48]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (6ff8b3a7-f719-4505-a266-79e287afe583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52149e0-b32e-45fa-86f8-2ee3e4d05ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450" returned: 0 in 0.900s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:04 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.286s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109830173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04e241b-8061-4be3-b8bc-4ac840df87e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:57Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Creating volume d04e241b-8061-4be3-b8bc-4ac840df87e4 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:04 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:04 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 1073741824 Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52149e0-b32e-45fa-86f8-2ee3e4d05ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64318612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d70a81-d9f7-4e52-bf14-20642b097bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:05Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:04 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c8b631-52ad-49d0-9482-e555b5404ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c8b631-52ad-49d0-9482-e555b5404ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b313b2ac-ca17-49ab-b6b1-efc5cf909a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b313b2ac-ca17-49ab-b6b1-efc5cf909a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d70a81-d9f7-4e52-bf14-20642b097bd8', 'volume_name': 'volume-98d70a81-d9f7-4e52-bf14-20642b097bd8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:04 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD Jul 07 10:54:04 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40619b59-e700-4ef0-8b99-802f7de6339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40619b59-e700-4ef0-8b99-802f7de6339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a4c0e6-c514-41c3-a51a-7eb8393acacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:04 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Volume 98d70a81-d9f7-4e52-bf14-20642b097bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d70a81-d9f7-4e52-bf14-20642b097bd8', 'volume_size': 1} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ae0c02-39cb-442c-9776-1962f8ac783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81816ae4-7db4-462a-9808-7d3b920ea450', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ef15b2-6226-4517-a0f2-4138cd7fac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-quobyte-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:04 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume volume-81816ae4-7db4-462a-9808-7d3b920ea450 (81816ae4-7db4-462a-9808-7d3b920ea450): created successfully Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ef15b2-6226-4517-a0f2-4138cd7fac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (34ed386d-8594-46e4-bcfe-9be7f65aca55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-432ad29e-3ac1-461a-b5ab-53e6c86f8523 tempest-CreateVolumesFromSnapshotTest-382660073 None] Created volume successfully. Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dd6942-d165-406a-ac23-1a617b73e873]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:05 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 Jul 07 10:54:05 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:05 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.031s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:05 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Deleted volume successfully. Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-74380683-e45a-43df-8d42-c3974baf82a8 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-6ed4d1e1-1db4-4676-a0ca-8f9ce336ed20-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:05 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD" returned: 0 in 0.955s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:05 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD Jul 07 10:54:05 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:05 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6" returned: 0 in 0.884s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:05 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 1073741824" returned: 0 in 1.071s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:05 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6 Jul 07 10:54:05 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:05 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 Jul 07 10:54:05 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:06 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD" returned: 1 in 0.785s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] 46a0347e-ecde-4bf7-96ed-3c5c08359641 was raw, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:06 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a Jul 07 10:54:06 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:06 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6" returned: 0 in 0.680s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6" released by "delete_volume" :: held 1.619s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:06 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.701s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16765995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:58Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Creating volume e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:06 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95674bba-480d-44e1-8314-0e9b70736c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04e241b-8061-4be3-b8bc-4ac840df87e4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:06 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 1073741824 Jul 07 10:54:06 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ce3afc-dff4-4572-a7aa-35a4f0ca7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:06 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 (d04e241b-8061-4be3-b8bc-4ac840df87e4): created successfully Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ce3afc-dff4-4572-a7aa-35a4f0ca7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (4726730f-0938-4668-9726-41df095c6d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created reservations ['33bdd948-f968-48f3-afca-44b23797ba68', '8b6ccfc0-44c0-4884-ac5e-37af620b5447', 'd86bb17e-c140-4b1c-b004-de12fe6026ad', '2b326dff-ba7b-448b-9d67-9132b2f0ff24'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b749e118-6af1-488a-ae47-8f3d60c040dc tempest-CreateVolumesFromSnapshotTest-382660073 None] Created volume successfully. Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:06 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:06 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-60d99a4b-5a5e-438c-9708-8e09d87d4106-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-60d99a4b-5a5e-438c-9708-8e09d87d4106-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-quobyte-60d99a4b-5a5e-438c-9708-8e09d87d4106" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:06 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-60d99a4b-5a5e-438c-9708-8e09d87d4106" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77f66ad-8542-4bdf-a0a2-eb222188088b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:07 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 Jul 07 10:54:07 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:07 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" returned: 0 in 0.817s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_46a0347e-ecde-4bf7-96ed-3c5c08359641_vtdesbe5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:54:07 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:07 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a 1G Jul 07 10:54:07 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:07 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 1073741824" returned: 0 in 0.995s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:07 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.851s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Deleted volume successfully. Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bf83a096-0fc8-4bca-ac98-fb39be76a041 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-294872d8-9eef-4df5-a37e-6f7bf6b3f1a6-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:07 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 Jul 07 10:54:07 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:07 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106" returned: 0 in 0.876s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:07 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106 Jul 07 10:54:07 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:07 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a 1G" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ede83-c7d4-4f74-a2c9-adc81a21fcb1]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:08 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a Jul 07 10:54:08 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:08 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8" returned: 0 in 0.710s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.985s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850850230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6416e4ec-da8e-47c2-90f5-77346a7a0208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:58Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Creating volume 6416e4ec-da8e-47c2-90f5-77346a7a0208 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:08 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a7bcc2-1042-4f6f-a5dd-382e0518b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:08 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 1073741824 Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac147f6-c672-4de0-bc2f-b9ccac438f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:08 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:08 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 (e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8): created successfully Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac147f6-c672-4de0-bc2f-b9ccac438f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (01ea4ddc-5aed-4232-bf19-576b2023b942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:08 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c304f516-c163-40e9-86a9-17ec570551ff tempest-CreateVolumesFromSnapshotTest-382660073 None] Created volume successfully. Jul 07 10:54:08 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-60d99a4b-5a5e-438c-9708-8e09d87d4106" returned: 0 in 0.693s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-60d99a4b-5a5e-438c-9708-8e09d87d4106" released by "delete_volume" :: held 1.615s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created reservations ['f47c56c9-e7a5-46ed-bf18-8690e8d89c40', 'de561e92-c4ab-4a44-b42b-f679ae53aea2', '2aa57c73-55b2-4240-ab58-6ae1bad19d45', '28767564-5ca2-4c95-8d4d-870268839071'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:08 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:08 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:08 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" returned: 0 in 0.848s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:08 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a Jul 07 10:54:08 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-33f94b4d-e728-40b4-b036-66aa96c46b99-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-33f94b4d-e728-40b4-b036-66aa96c46b99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-quobyte-33f94b4d-e728-40b4-b036-66aa96c46b99" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-33f94b4d-e728-40b4-b036-66aa96c46b99" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[21173ae2-3795-4af8-9878-ecd2133204d3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:09 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 1073741824" returned: 0 in 1.052s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:09 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 Jul 07 10:54:09 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:09 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 Jul 07 10:54:09 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:09 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.807s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Deleted volume successfully. Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-89a1ef3b-bcc7-4b42-84e1-b1834d55f3cb tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-60d99a4b-5a5e-438c-9708-8e09d87d4106-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:09 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" returned: 1 in 0.993s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Downloaded image 46a0347e-ecde-4bf7-96ed-3c5c08359641 ((None, [{'url': 'file:///opt/stack/data/glance/images/46a0347e-ecde-4bf7-96ed-3c5c08359641', 'metadata': {}}])) to volume 6d6303e0-976e-4a7f-96b1-30c5e5ba716a successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Temporary image 46a0347e-ecde-4bf7-96ed-3c5c08359641 for user 5ff15c47255e4a609be966c032c87880 is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Marking volume 6d6303e0-976e-4a7f-96b1-30c5e5ba716a as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Copying metadata from image 46a0347e-ecde-4bf7-96ed-3c5c08359641 to 6d6303e0-976e-4a7f-96b1-30c5e5ba716a. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Creating volume glance metadata for volume 6d6303e0-976e-4a7f-96b1-30c5e5ba716a backed by image 46a0347e-ecde-4bf7-96ed-3c5c08359641 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '46a0347e-ecde-4bf7-96ed-3c5c08359641', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9868b49ddfd80492e095f49a2b21a170', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e1a835-d92b-497b-b23c-dfec7ad35bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a', 'volume_size': 1, 'image_id': '46a0347e-ecde-4bf7-96ed-3c5c08359641', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46a0347e-ecde-4bf7-96ed-3c5c08359641', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9868b49ddfd80492e095f49a2b21a170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb9f592c07e54c2b9178b6548f4aaeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e67447e81a0797c12de7d246bc91057f0941fa1af85d6db8b058a37a1ab38838ec039dda0ea4f9a52fc40d4eccbf03e8385ae81be6851da5ecd3306d4f51ec1', 'id': '46a0347e-ecde-4bf7-96ed-3c5c08359641', 'created_at': datetime.datetime(2026, 7, 7, 8, 53, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 53, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46a0347e-ecde-4bf7-96ed-3c5c08359641/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312ae5c8-4f13-47b2-a23a-8f039acba013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:09 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Volume volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a (6d6303e0-976e-4a7f-96b1-30c5e5ba716a): created successfully Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312ae5c8-4f13-47b2-a23a-8f039acba013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:09 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Flow 'volume_create_manager' (5a34b0cf-52c9-4100-93a8-eb743d529b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:09 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6d4593c9-e7de-42e2-91a5-b012cc4c31cc tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Created volume successfully. Jul 07 10:54:10 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208" returned: 0 in 0.771s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.415s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628764896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46557472c79b48a2b8f78d219a0aadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:53:59Z,use_quota=True,user_id='4eaa43c0befa46a88f27005ba768a59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Creating volume 15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:10 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:10 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb 1073741824 Jul 07 10:54:10 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:10 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99" returned: 0 in 0.918s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d5bb85-a9c3-4c9d-8351-b1a2b8124774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6416e4ec-da8e-47c2-90f5-77346a7a0208', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad64b10-60a1-4117-8db3-65414d64d36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:10 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99 Jul 07 10:54:10 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:10 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 (6416e4ec-da8e-47c2-90f5-77346a7a0208): created successfully Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad64b10-60a1-4117-8db3-65414d64d36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (9cfd79ea-d30f-43b0-9071-4d6295980387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:10 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c637232e-e233-44d0-9f8f-c287a09930e5 tempest-CreateVolumesFromSnapshotTest-382660073 None] Created volume successfully. Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Acquiring lock "cinder-6d6303e0-976e-4a7f-96b1-30c5e5ba716a-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "cinder-6d6303e0-976e-4a7f-96b1-30c5e5ba716a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Acquiring lock "cinder-quobyte-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "cinder-quobyte-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b932a036-1245-49a6-97e6-ce6ce0c9b478]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:10 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a Jul 07 10:54:10 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:10 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-33f94b4d-e728-40b4-b036-66aa96c46b99" returned: 0 in 0.737s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-33f94b4d-e728-40b4-b036-66aa96c46b99" released by "delete_volume" :: held 1.743s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created reservations ['aa83d733-e382-41cd-b301-81a27a99eb0a', '00a2a024-844a-427d-ad56-723a502eb242', '6ba92df6-8d97-46c2-8295-90aba777f77f', '6c11c2ce-5c91-4867-b865-ee306a5d72bb'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:11 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:11 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:11 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb 1073741824" returned: 0 in 0.981s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:11 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb Jul 07 10:54:11 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:11 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" returned: 0 in 0.795s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-2aeb46a4-be5f-4a84-bce7-19384878cc17-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-2aeb46a4-be5f-4a84-bce7-19384878cc17-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-quobyte-2aeb46a4-be5f-4a84-bce7-19384878cc17" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:11 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-2aeb46a4-be5f-4a84-bce7-19384878cc17" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:11 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1875828-8fdc-4b17-b4c0-e75e906fea1b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:11 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 Jul 07 10:54:11 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:11 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb" returned: 0 in 0.753s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.190s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:11 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64318612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d70a81-d9f7-4e52-bf14-20642b097bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:05Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Creating volume 98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:12 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.873s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Deleted volume successfully. Jul 07 10:54:12 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 1073741824 Jul 07 10:54:12 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01ae0e3-8a6d-475d-a1d6-6b73168ba57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ddff87-d323-4543-8809-e1ecd1edfa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:12 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Volume volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb (15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb): created successfully Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ddff87-d323-4543-8809-e1ecd1edfa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Flow 'volume_create_manager' (c8271376-d9cf-46d0-b35e-221f90f700f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-73d60119-94ef-4795-9f72-e39440b2574d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-33f94b4d-e728-40b4-b036-66aa96c46b99-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:12 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d33e787f-29b2-4641-8598-4017945a98ba tempest-CreateVolumesFromSnapshotTest-382660073 None] Created volume successfully. Jul 07 10:54:12 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" returned: 1 in 0.972s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:12 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a Jul 07 10:54:12 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:12 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17" returned: 0 in 0.821s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:12 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17 Jul 07 10:54:12 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:12 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 1073741824" returned: 0 in 0.890s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:12 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 Jul 07 10:54:12 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:13 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:13 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" returned: 0 in 0.782s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-2aeb46a4-be5f-4a84-bce7-19384878cc17" returned: 0 in 0.693s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-2aeb46a4-be5f-4a84-bce7-19384878cc17" released by "delete_volume" :: held 1.586s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "cinder-quobyte-6d6303e0-976e-4a7f-96b1-30c5e5ba716a" released by "delete_volume" :: held 2.642s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created reservations ['0811ace7-6729-4891-aadb-536b102cc56c', '2286b8a8-56cc-4e6e-9bc0-19e7361c8623', 'bab1ad20-f3c5-4215-813d-104c404f5d61', '6bbae341-c844-402c-be44-5089b9ab8213'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[384cde38-4aba-4529-ac01-41276ee9ac77]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Created reservations ['2d1565f2-3b85-46b1-b3b8-bc7b0f434648', 'd6a29ccc-ffea-4b99-ab00-a3052f5eb98f', '0a047195-fa07-41c6-b259-e2c13f5d765e', 'a7f559aa-b5b1-4b15-ba83-7119dccc23ce'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:13 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb Jul 07 10:54:13 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:13 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:13 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:13 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:13 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:13 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a4c0e6-c514-41c3-a51a-7eb8393acacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d70a81-d9f7-4e52-bf14-20642b097bd8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b981c9-8bd6-4755-a9bb-e2d629ae1859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:13 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Volume volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 (98d70a81-d9f7-4e52-bf14-20642b097bd8): created successfully Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b981c9-8bd6-4755-a9bb-e2d629ae1859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (6ff8b3a7-f719-4505-a266-79e287afe583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-609c1ed8-d8ab-450e-bfed-f9d1fb780918 tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-ee4e05ee-1d6d-4460-8af4-dbfe71058e15-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-ee4e05ee-1d6d-4460-8af4-dbfe71058e15-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:13 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "cinder-quobyte-ee4e05ee-1d6d-4460-8af4-dbfe71058e15" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-ee4e05ee-1d6d-4460-8af4-dbfe71058e15" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2356c0-6726-447a-bc55-79c142df8467]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:14 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 Jul 07 10:54:14 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:14 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb" returned: 0 in 1.101s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:14 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.962s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Deleted volume successfully. Jul 07 10:54:14 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb Jul 07 10:54:14 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3e7b1e33-c8aa-444b-b247-0d8e00050525 tempest-VolumeAndVolumeTypeFromImageTest-1682152939 None] Lock "cinder-6d6303e0-976e-4a7f-96b1-30c5e5ba716a-delete_volume" released by "delete_volume" :: held 4.037s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:14 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.154s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:14 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Deleted volume successfully. Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9bb32010-b247-4aec-a7f1-0d2912be7128 tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-2aeb46a4-be5f-4a84-bce7-19384878cc17-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot dfdff901-d465-45e2-bd00-48001d6eaa44 of volume 98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b542c7-1cf0-45e4-8e7a-5f85f5927aa1]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:15 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 Jul 07 10:54:15 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:15 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15" returned: 0 in 1.172s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:15 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15 Jul 07 10:54:15 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:15 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb" returned: 0 in 0.933s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb" released by "delete_volume" :: held 2.093s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Created reservations ['a6341a03-eaac-4d07-9200-70bd3cb6d0f2', '566d8487-1bff-42c8-acd9-b729b57d46f5', 'af8e0e83-fe60-427b-aa93-a43b0ff268d7', '6f14a13f-aeb3-4a7a-9bda-b2f5c8266dba'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:15 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:15 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:15 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8" returned: 0 in 0.998s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:15 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 1G Jul 07 10:54:15 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:16 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ee4e05ee-1d6d-4460-8af4-dbfe71058e15" returned: 0 in 0.790s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-quobyte-ee4e05ee-1d6d-4460-8af4-dbfe71058e15" released by "delete_volume" :: held 2.039s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Created reservations ['4b392ff5-a191-4afe-845f-cf6b24e80d8a', '1cd40dbd-e8bf-4023-b15f-b2ef711ca385', '79ec5cd8-fb54-4277-8c3c-1782237753ad', '7efb4031-3b4a-4c37-90ec-7bdf1d410892'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:16 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:16 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:16 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.811s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Deleted volume successfully. Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3fbb3451-10b3-4a40-8026-95d40044e006 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-15d059c7-3b8d-476e-9d1c-33f1cd3dfaeb-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-6416e4ec-da8e-47c2-90f5-77346a7a0208-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-6416e4ec-da8e-47c2-90f5-77346a7a0208-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-6416e4ec-da8e-47c2-90f5-77346a7a0208" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-6416e4ec-da8e-47c2-90f5-77346a7a0208" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed749c-6f33-4230-a204-710928dbaa80]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:16 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 1G" returned: 0 in 1.056s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:16 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 Jul 07 10:54:16 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:16 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 Jul 07 10:54:16 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:17 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.839s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:17 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:17 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Deleted volume successfully. Jul 07 10:54:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-dadcd56a-6e03-4166-b3ab-d0dd4428a17d tempest-CreateVolumesFromSourceVolumeTest-1436821085 None] Lock "cinder-ee4e05ee-1d6d-4460-8af4-dbfe71058e15-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:17 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208" returned: 0 in 0.989s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:17 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208 Jul 07 10:54:17 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:17 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44" returned: 0 in 0.869s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:17 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 is being set with open permissions: ugo+rw Jul 07 10:54:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:17 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 Jul 07 10:54:17 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:18 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-6416e4ec-da8e-47c2-90f5-77346a7a0208" returned: 0 in 0.815s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-6416e4ec-da8e-47c2-90f5-77346a7a0208" released by "delete_volume" :: held 1.861s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:18 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44" returned: 0 in 0.813s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Created reservations ['3f7dcb47-ef93-4b10-bee0-7f2673112753', '109d6bbc-2937-46c0-85fe-4abd3b3a657c', '9bb935b9-68a8-4cf1-b99c-7a553c86eb3c', 'd4f8d7f5-235d-4f21-a2fa-24b3400958de'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:18 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.info Jul 07 10:54:18 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:18 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:18 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8" acquired by "delete_volume" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd358d-33a3-4e7e-b5f6-79ef19cc1a0d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:19 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 Jul 07 10:54:19 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:19 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.info" returned: 0 in 0.997s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:19 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.info is being set with open permissions: ugo+rw Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:19 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.info Jul 07 10:54:19 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:19 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.956s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:19 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Deleted volume successfully. Jul 07 10:54:19 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fcf3a871-6c6e-4f47-b685-4a18eb98785b tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-6416e4ec-da8e-47c2-90f5-77346a7a0208-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:20 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8" returned: 0 in 1.013s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:20 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8 Jul 07 10:54:20 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:20 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.info" returned: 0 in 0.836s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.695s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:20 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2e54a63d-d5db-4ccc-81e3-253c83475468 tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:54:20 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8" returned: 0 in 0.743s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8" released by "delete_volume" :: held 1.819s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Created reservations ['915da7a6-5dde-4337-9d1c-9e92b0050273', '32a27481-79de-493c-b8b8-e454ca9a95e4', '13a52644-b3d2-4807-8038-5f59c1324d63', '58ef4cab-ef77-46a4-ae75-8ce1b761b8b4'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:20 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:20 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Flow 'volume_create_manager' (6347c424-1368-431a-bc80-45e1195e58e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfabd18b-071c-413d-8d3c-69b2dd210a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-dfdff901-d465-45e2-bd00-48001d6eaa44-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfabd18b-071c-413d-8d3c-69b2dd210a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-673485455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6e423f-cdcf-4744-96eb-5130e31f73ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be99315b06ba46fe8779b03be90725ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:21Z,use_quota=True,user_id='99479ea4ea8543d68bafa268b6164849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf8646f-9e49-4b46-b397-f03509a1f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf8646f-9e49-4b46-b397-f03509a1f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cdba56-9713-4d59-b140-b8257fea98a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cdba56-9713-4d59-b140-b8257fea98a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6e423f-cdcf-4744-96eb-5130e31f73ea', 'volume_name': 'volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eada2ab6-6718-4897-a2dd-e11e8abde762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eada2ab6-6718-4897-a2dd-e11e8abde762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7566fc-b830-412c-a8bc-341665772fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:21 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Volume 1d6e423f-cdcf-4744-96eb-5130e31f73ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea', 'volume_size': 1} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-673485455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6e423f-cdcf-4744-96eb-5130e31f73ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be99315b06ba46fe8779b03be90725ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:21Z,use_quota=True,user_id='99479ea4ea8543d68bafa268b6164849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Creating volume 1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:21 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-d04e241b-8061-4be3-b8bc-4ac840df87e4-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Lock "cinder-dfdff901-d465-45e2-bd00-48001d6eaa44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.143s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-98d70a81-d9f7-4e52-bf14-20642b097bd8" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:21 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea 1073741824 Jul 07 10:54:21 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-d04e241b-8061-4be3-b8bc-4ac840df87e4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-98d70a81-d9f7-4e52-bf14-20642b097bd8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-dfdff901-d465-45e2-bd00-48001d6eaa44" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-dfdff901-d465-45e2-bd00-48001d6eaa44" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot dfdff901-d465-45e2-bd00-48001d6eaa44 of volume 98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e40f152-63b9-4a91-ba79-236b603db837]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-d04e241b-8061-4be3-b8bc-4ac840df87e4" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-d04e241b-8061-4be3-b8bc-4ac840df87e4" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff88771-d7fe-4e0d-ad7e-367e582c3481]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:21 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 Jul 07 10:54:21 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:21 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 Jul 07 10:54:21 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:21 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.892s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Deleted volume successfully. Jul 07 10:54:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c358696c-c2ca-423d-aab0-2f5ff6e7f63a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-e515d29c-9a2e-4fd8-a1f5-f45eb6892ba8-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:22 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea 1073741824" returned: 0 in 1.069s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:22 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44" returned: 0 in 1.031s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98d70a81-d9f7-4e52-bf14-20642b097bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:54:22 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea Jul 07 10:54:22 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc86b65-b863-40e0-ad83-51385680774b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:22 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4" returned: 0 in 1.007s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:22 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4 Jul 07 10:54:22 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:22 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 Jul 07 10:54:22 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:23 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:23 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea" returned: 0 in 0.863s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d04e241b-8061-4be3-b8bc-4ac840df87e4" returned: 0 in 0.755s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-d04e241b-8061-4be3-b8bc-4ac840df87e4" released by "delete_volume" :: held 1.820s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7566fc-b830-412c-a8bc-341665772fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b8c274-ded2-4c22-8a58-ea9fda250aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:23 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Volume volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea (1d6e423f-cdcf-4744-96eb-5130e31f73ea): created successfully Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b8c274-ded2-4c22-8a58-ea9fda250aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Flow 'volume_create_manager' (6347c424-1368-431a-bc80-45e1195e58e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b6ea6485-823c-46d2-9ba4-38bfb729a3c6 tempest-VolumeDependencyTests-1730425483 None] Created volume successfully. Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Created reservations ['18e22e70-c559-4bba-8a07-2ef240f7936b', '10de3eb6-4755-4c88-9405-e47bbcb5f8b1', 'e159951f-5d64-423c-91c0-c578606bd304', '800eef75-cf09-41cc-8243-51a883d2ba35'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:23 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8" returned: 0 in 1.034s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:23 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:23 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-81816ae4-7db4-462a-9808-7d3b920ea450-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:23 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:23 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-81816ae4-7db4-462a-9808-7d3b920ea450-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:23 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:23 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-81816ae4-7db4-462a-9808-7d3b920ea450" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-81816ae4-7db4-462a-9808-7d3b920ea450" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[15febe41-4679-4eed-a66d-6853e6e6be42]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:24 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 Jul 07 10:54:24 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:24 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.978s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:24 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 1.149s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Deleted volume successfully. Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Creating offline snapshot d12935e9-ec9d-4cfa-a186-ece74a1bab43 of volume 1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-926061e2-ce14-4497-9079-badcad48dc25 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-d04e241b-8061-4be3-b8bc-4ac840df87e4-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd7cde4-09bd-47e5-827f-5a35d2c82f1d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:24 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44" returned: 0 in 1.302s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:24 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44 Jul 07 10:54:24 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:24 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea Jul 07 10:54:24 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:25 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450" returned: 0 in 1.211s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:25 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450 Jul 07 10:54:25 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:25 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8.dfdff901-d465-45e2-bd00-48001d6eaa44" returned: 0 in 0.742s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-dfdff901-d465-45e2-bd00-48001d6eaa44" released by "_delete_snapshot" :: held 4.245s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-98d70a81-d9f7-4e52-bf14-20642b097bd8" released by "delete_snapshot" :: held 4.275s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:25 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea" returned: 0 in 0.897s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:25 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 1G Jul 07 10:54:25 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Created reservations ['66ea6f0f-5481-4e37-b824-1b95bec64252', 'd8a459ae-36ef-4b82-be1a-826c890de415', 'eb384990-eb74-4949-a620-df288da81434', '7c8073bb-5d39-46d3-9158-dba9c9123e24'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:25 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-81816ae4-7db4-462a-9808-7d3b920ea450" returned: 0 in 0.798s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-81816ae4-7db4-462a-9808-7d3b920ea450" released by "delete_volume" :: held 2.074s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:25 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-601e75b3-c69c-47f9-8614-6f97f78688ba tempest-ProjectMemberTests-1828713728 None] Lock "cinder-dfdff901-d465-45e2-bd00-48001d6eaa44-delete_snapshot" released by "delete_snapshot" :: held 4.545s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Created reservations ['6a073de9-03d4-4bd6-82b2-777be87cbc7d', 'e74338bf-80e8-4ccb-aeac-2f8c4fb2d438', '6e0c8ac3-2211-4877-9336-75c9263f3949', '53d0b9ee-d6d7-404a-b56d-d54bcfa45f60'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:26 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:26 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:26 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 1G" returned: 0 in 0.838s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:26 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 Jul 07 10:54:26 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-98d70a81-d9f7-4e52-bf14-20642b097bd8-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-98d70a81-d9f7-4e52-bf14-20642b097bd8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-98d70a81-d9f7-4e52-bf14-20642b097bd8" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-98d70a81-d9f7-4e52-bf14-20642b097bd8" acquired by "delete_volume" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:26 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.786s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7304e6ec-f716-429b-b6fe-edba7e020a6f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Deleted volume successfully. Jul 07 10:54:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa5dd9d-687d-4090-9927-4ffd18ed522a tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-81816ae4-7db4-462a-9808-7d3b920ea450-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:26 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 Jul 07 10:54:27 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (b70d5e0f-af64-4928-9250-3d2cbe0cdfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e72b4a-4269-4c1b-9276-ed8c4801ac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-550c8c62-e460-484b-bea6-a62e785fa345-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e72b4a-4269-4c1b-9276-ed8c4801ac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1290929836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce318a7b-37ed-409e-aa60-7cb35abfc236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:27Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1318f5c2-d916-4297-88de-6fc71059df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1318f5c2-d916-4297-88de-6fc71059df2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1467f18c-416e-481c-a733-4f03c6e3e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1467f18c-416e-481c-a733-4f03c6e3e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce318a7b-37ed-409e-aa60-7cb35abfc236', 'volume_name': 'volume-ce318a7b-37ed-409e-aa60-7cb35abfc236', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9553a4f-e35f-4694-85aa-a22ced67bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9553a4f-e35f-4694-85aa-a22ced67bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1aae50c-4067-4db9-b7bb-f96a4c7a9f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:27 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Volume ce318a7b-37ed-409e-aa60-7cb35abfc236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce318a7b-37ed-409e-aa60-7cb35abfc236', 'volume_size': 1} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-550c8c62-e460-484b-bea6-a62e785fa345-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-fdf24afe-530d-42ec-9aae-64e84fd1517b" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-fdf24afe-530d-42ec-9aae-64e84fd1517b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-550c8c62-e460-484b-bea6-a62e785fa345" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-550c8c62-e460-484b-bea6-a62e785fa345" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Deleting offline snapshot 550c8c62-e460-484b-bea6-a62e785fa345 of volume fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] snapshot_file for this snap is: volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed87717-73c1-4164-81d3-9820e80aeffa]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:27 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 Jul 07 10:54:27 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:27 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43" returned: 0 in 0.884s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:27 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 is being set with open permissions: ugo+rw Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:27 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 Jul 07 10:54:27 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:27 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8" returned: 0 in 0.898s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:27 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8 Jul 07 10:54:27 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:28 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345" returned: 0 in 0.818s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf24afe-530d-42ec-9aae-64e84fd1517b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c9efe2-2d96-4d04-8fd0-fafa465ab3d0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:28 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43" returned: 0 in 0.681s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:28 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.info Jul 07 10:54:28 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:28 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b Jul 07 10:54:28 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:28 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-98d70a81-d9f7-4e52-bf14-20642b097bd8" returned: 0 in 0.682s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-98d70a81-d9f7-4e52-bf14-20642b097bd8" released by "delete_volume" :: held 1.659s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Created reservations ['c7ea2d70-adc7-4f7b-b827-151f5fa9f54b', 'bdd1bf4c-eb23-4bbe-9916-0d656e680d20', '21d0f0a4-a29d-455b-a125-e9d0a15b12a9', 'b53d70b7-95a0-46d4-b801-0441568eee0d'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:28 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:28 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:28 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.info" returned: 0 in 0.689s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:28 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.info is being set with open permissions: ugo+rw Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:28 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b" returned: 0 in 0.797s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:28 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.info Jul 07 10:54:28 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:28 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 Jul 07 10:54:28 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:29 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1defc89e-ad7e-456a-b95d-d8153eaed4f0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-98d70a81-d9f7-4e52-bf14-20642b097bd8-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (daadbc17-2915-4f55-8f27-c753c4eb2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8a1025-19c1-4947-ab72-a94caef7f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8a1025-19c1-4947-ab72-a94caef7f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108224093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253a7266-c887-4984-8595-e440fe35df8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:29Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e666e014-40af-4b4d-93d9-2b96fd8ad8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e666e014-40af-4b4d-93d9-2b96fd8ad8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d06c2f-ffe1-404d-9ba3-d607957fa602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d06c2f-ffe1-404d-9ba3-d607957fa602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253a7266-c887-4984-8595-e440fe35df8c', 'volume_name': 'volume-253a7266-c887-4984-8595-e440fe35df8c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45610c22-150f-41d6-852a-abc2834e338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45610c22-150f-41d6-852a-abc2834e338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:29 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93309812-12ee-43ab-bf85-7432aa1eae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:29 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Volume 253a7266-c887-4984-8595-e440fe35df8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253a7266-c887-4984-8595-e440fe35df8c', 'volume_size': 1} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.info" returned: 0 in 0.776s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.883s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.475s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1290929836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce318a7b-37ed-409e-aa60-7cb35abfc236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:27Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Creating volume ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:29 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:29 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 1073741824 Jul 07 10:54:29 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-aadb8235-384c-4340-a3db-8ea556d3346b tempest-VolumeDependencyTests-1730425483 None] Create snapshot completed successfully Jul 07 10:54:29 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345" returned: 0 in 0.845s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:29 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345 Jul 07 10:54:29 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:30 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b.550c8c62-e460-484b-bea6-a62e785fa345" returned: 0 in 0.672s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-550c8c62-e460-484b-bea6-a62e785fa345" released by "_delete_snapshot" :: held 3.246s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-fdf24afe-530d-42ec-9aae-64e84fd1517b" released by "delete_snapshot" :: held 3.273s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Created reservations ['21b4f85b-83ce-4893-9013-e8a61e673c57', '8b74ee95-bc25-4a97-8a17-9a4742169144', '8d61c30d-1737-4a75-9c2a-d7d6bf87abe0', '778f6c2a-4708-441d-ab30-ef6caa168712'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:30 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Flow 'volume_create_manager' (e3c5e28c-67da-4bad-b447-5f9ab4747c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b97244e-79d5-48e1-8201-735438645881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 1073741824" returned: 0 in 1.003s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b97244e-79d5-48e1-8201-735438645881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1331187239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a170b73f-edd6-489b-ae18-622ddc8aa964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be99315b06ba46fe8779b03be90725ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d12935e9-ec9d-4cfa-a186-ece74a1bab43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:30Z,use_quota=True,user_id='99479ea4ea8543d68bafa268b6164849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca58bcb-a25b-47d5-a5d8-f69569f1d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca58bcb-a25b-47d5-a5d8-f69569f1d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64041af1-8eca-4dab-b71e-ba2e80ded80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64041af1-8eca-4dab-b71e-ba2e80ded80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a170b73f-edd6-489b-ae18-622ddc8aa964', 'volume_name': 'volume-a170b73f-edd6-489b-ae18-622ddc8aa964', 'volume_size': 1, 'snapshot_id': 'd12935e9-ec9d-4cfa-a186-ece74a1bab43'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4faedfc-d238-45da-8f2d-825bfa6ada14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4faedfc-d238-45da-8f2d-825bfa6ada14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ca7325-6604-4d40-b421-fc8b3f503353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:30 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Volume a170b73f-edd6-489b-ae18-622ddc8aa964: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a170b73f-edd6-489b-ae18-622ddc8aa964', 'volume_size': 1, 'snapshot_id': 'd12935e9-ec9d-4cfa-a186-ece74a1bab43'} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Delete snapshot completed successfully. Jul 07 10:54:30 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 Jul 07 10:54:30 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b1339c61-37d9-4c70-95cc-25504862daf1 tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-550c8c62-e460-484b-bea6-a62e785fa345-delete_snapshot" released by "delete_snapshot" :: held 3.676s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-fdf24afe-530d-42ec-9aae-64e84fd1517b-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-fdf24afe-530d-42ec-9aae-64e84fd1517b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "cinder-quobyte-fdf24afe-530d-42ec-9aae-64e84fd1517b" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-fdf24afe-530d-42ec-9aae-64e84fd1517b" acquired by "delete_volume" :: waited 0.029s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:31 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236" returned: 0 in 0.659s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.852s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108224093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253a7266-c887-4984-8595-e440fe35df8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:29Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Creating volume 253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:31 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5213ae7a-8175-45de-9278-db05d8cb7d6f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:31 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c 1073741824 Jul 07 10:54:31 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1aae50c-4067-4db9-b7bb-f96a4c7a9f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce318a7b-37ed-409e-aa60-7cb35abfc236', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba121b1c-46de-4d31-be0b-6e7739871d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:31 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Volume volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 (ce318a7b-37ed-409e-aa60-7cb35abfc236): created successfully Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba121b1c-46de-4d31-be0b-6e7739871d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (b70d5e0f-af64-4928-9250-3d2cbe0cdfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-34dd8de2-8c6b-4557-9c91-32faaa88227b tempest-ProjectReaderTests-1999001315 None] Created volume successfully. Jul 07 10:54:31 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b Jul 07 10:54:31 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:32 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b" returned: 0 in 0.782s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:32 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c 1073741824" returned: 0 in 0.816s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:32 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b Jul 07 10:54:32 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:32 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c Jul 07 10:54:32 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:32 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdf24afe-530d-42ec-9aae-64e84fd1517b" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-quobyte-fdf24afe-530d-42ec-9aae-64e84fd1517b" released by "delete_volume" :: held 1.553s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:32 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c" returned: 0 in 0.671s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.290s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:32 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-quobyte-d12935e9-ec9d-4cfa-a186-ece74a1bab43-a170b73f-edd6-489b-ae18-622ddc8aa964" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-d12935e9-ec9d-4cfa-a186-ece74a1bab43-a170b73f-edd6-489b-ae18-622ddc8aa964" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Creating volume a170b73f-edd6-489b-ae18-622ddc8aa964 from snapshot d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-quobyte-a170b73f-edd6-489b-ae18-622ddc8aa964" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93309812-12ee-43ab-bf85-7432aa1eae07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253a7266-c887-4984-8595-e440fe35df8c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fdeb79-eff2-4700-b9b6-53421f56d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-a170b73f-edd6-489b-ae18-622ddc8aa964" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] snapshot: d12935e9-ec9d-4cfa-a186-ece74a1bab43, volume: a170b73f-edd6-489b-ae18-622ddc8aa964, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Created reservations ['2ccc6baa-7e01-45cc-9293-0fd0247943f0', '97b45964-1723-404c-b555-1231e0803558', '03ae3fa3-1e10-41e0-a67a-b0166d4d70d5', '3361026b-dd69-4497-b299-bff7a2f12041'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:33 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Volume volume-253a7266-c887-4984-8595-e440fe35df8c (253a7266-c887-4984-8595-e440fe35df8c): created successfully Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fdeb79-eff2-4700-b9b6-53421f56d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (daadbc17-2915-4f55-8f27-c753c4eb2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e88dff50-9224-41ae-8b8d-09bb50c59d4d tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4827d9-8d0b-4ee3-9b70-5753af34ea97]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:33 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:33 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:33 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 Jul 07 10:54:33 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:33 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.671s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Deleted volume successfully. Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=175,cinder:UPDATE=233,cinder:INSERT=65,cinder:DELETE=20 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-92e92e81-a11d-4fc1-952c-4e6341ed01cb tempest-CreateVolumesFromSnapshotTest-382660073 None] Lock "cinder-fdf24afe-530d-42ec-9aae-64e84fd1517b-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:34 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43" returned: 0 in 0.898s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9dd623-ece5-47c6-9ab2-baa0b9de6bc9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:34 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea Jul 07 10:54:34 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:34 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea" returned: 0 in 0.835s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:54:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:34 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 Jul 07 10:54:34 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:39 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964" returned: 0 in 5.121s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce89c906-f40f-4815-afb1-fa322ee082d5]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:40 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea Jul 07 10:54:40 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:40 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea" returned: 0 in 0.967s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:40 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:54:40 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Converted 1024.00 MB image at 199.89 MB/s Jul 07 10:54:40 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 is being set with open permissions: ugo+rw Jul 07 10:54:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:41 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 Jul 07 10:54:41 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=241,cinder:SELECT=166,cinder:INSERT=54,cinder:DELETE=24 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Flow 'volume_create_manager' (efbe3726-8c4c-4be9-a5ef-14bd923e0cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a85a0d5-9d1d-4279-b803-bdb7fcd1ba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a85a0d5-9d1d-4279-b803-bdb7fcd1ba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457a9f20-1e9d-4d07-8925-c1cd2963e758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039ba6d55aca4df5b18d2a6ff4406d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:41Z,use_quota=True,user_id='c81a53f102f64d889be8746be60e5ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7216f2-f9fd-4640-b8e9-6347f009d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7216f2-f9fd-4640-b8e9-6347f009d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7b8e2d-e92b-456a-abc9-47b8e3b4199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.image.glance [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Creating Keystone auth plugin from conf {{(pid=87208) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7b8e2d-e92b-456a-abc9-47b8e3b4199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '457a9f20-1e9d-4d07-8925-c1cd2963e758', 'volume_name': 'volume-457a9f20-1e9d-4d07-8925-c1cd2963e758', 'volume_size': 1, 'image_id': '764e0143-fd15-465a-b701-fd4f2cad184e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e0143-fd15-465a-b701-fd4f2cad184e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a469bbf0ce4ae64082d93702bdcc6406', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '039ba6d55aca4df5b18d2a6ff4406d48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b81b163425ea1f0afd9b713edeecdc71be0c0872b1b5d577907c04402d184bf1b44ffa1bb76574db7486f626d115d5c7218599218873323dfafdc451afb8a784', 'id': '764e0143-fd15-465a-b701-fd4f2cad184e', 'created_at': datetime.datetime(2026, 7, 7, 8, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 54, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e0143-fd15-465a-b701-fd4f2cad184e/file', 'properties': {}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300aa3b4-840b-4893-b8e8-26560a4cbbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300aa3b4-840b-4893-b8e8-26560a4cbbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc32d93-21b7-46d4-90ff-7c6a01081181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Volume 457a9f20-1e9d-4d07-8925-c1cd2963e758: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-457a9f20-1e9d-4d07-8925-c1cd2963e758', 'volume_size': 1, 'image_id': '764e0143-fd15-465a-b701-fd4f2cad184e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e0143-fd15-465a-b701-fd4f2cad184e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a469bbf0ce4ae64082d93702bdcc6406', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '039ba6d55aca4df5b18d2a6ff4406d48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b81b163425ea1f0afd9b713edeecdc71be0c0872b1b5d577907c04402d184bf1b44ffa1bb76574db7486f626d115d5c7218599218873323dfafdc451afb8a784', 'id': '764e0143-fd15-465a-b701-fd4f2cad184e', 'created_at': datetime.datetime(2026, 7, 7, 8, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 54, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e0143-fd15-465a-b701-fd4f2cad184e/file', 'properties': {}}, 'image_service': } Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Trying to clone 457a9f20-1e9d-4d07-8925-c1cd2963e758 from image 764e0143-fd15-465a-b701-fd4f2cad184e at location (None, [{'url': 'file:///opt/stack/data/glance/images/764e0143-fd15-465a-b701-fd4f2cad184e', 'metadata': {}}]). {{(pid=87208) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 10:54:41 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Image download 0.00 MB at 0.00 MB/s Jul 07 10:54:41 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964" returned: 0 in 0.676s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8930e28-2a50-490a-a013-d29b8b0c5026]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-a170b73f-edd6-489b-ae18-622ddc8aa964" released by "_copy_volume_from_snapshot" :: held 8.621s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-d12935e9-ec9d-4cfa-a186-ece74a1bab43-a170b73f-edd6-489b-ae18-622ddc8aa964" released by "_create_volume_from_snapshot" :: held 8.673s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.696s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.104s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Creating offline snapshot d8425a45-ec69-4c27-868b-0a7d48029cc2 of volume ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ca7325-6604-4d40-b421-fc8b3f503353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a170b73f-edd6-489b-ae18-622ddc8aa964', 'volume_size': 1, 'snapshot_id': 'd12935e9-ec9d-4cfa-a186-ece74a1bab43'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6965f5-d80c-4c36-af23-de12120ae30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dffddd3-55fb-40ef-a4bf-2f8dcbcde257]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Volume volume-a170b73f-edd6-489b-ae18-622ddc8aa964 (a170b73f-edd6-489b-ae18-622ddc8aa964): created successfully Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6965f5-d80c-4c36-af23-de12120ae30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:41 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD Jul 07 10:54:41 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Flow 'volume_create_manager' (e3c5e28c-67da-4bad-b447-5f9ab4747c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-879915e6-2718-4261-85e4-27d43e5059e0 tempest-VolumeDependencyTests-1730425483 None] Created volume successfully. Jul 07 10:54:41 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 Jul 07 10:54:41 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:42 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-d12935e9-ec9d-4cfa-a186-ece74a1bab43-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-d12935e9-ec9d-4cfa-a186-ece74a1bab43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-quobyte-1d6e423f-cdcf-4744-96eb-5130e31f73ea" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-1d6e423f-cdcf-4744-96eb-5130e31f73ea" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-quobyte-d12935e9-ec9d-4cfa-a186-ece74a1bab43" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-d12935e9-ec9d-4cfa-a186-ece74a1bab43" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Deleting offline snapshot d12935e9-ec9d-4cfa-a186-ece74a1bab43 of volume 1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] snapshot_file for this snap is: volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[915c1a60-96cf-4ffc-9329-9fc8f218626a]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:42 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236" returned: 0 in 0.805s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:42 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD Jul 07 10:54:42 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:42 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 1G Jul 07 10:54:42 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:42 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 Jul 07 10:54:42 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:43 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD" returned: 1 in 0.770s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Temporary image 764e0143-fd15-465a-b701-fd4f2cad184e is fetched for user c81a53f102f64d889be8746be60e5ea6. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e369df0e-c2e1-4793-8890-5fc30ee636c5]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:43 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43" returned: 0 in 0.777s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a6002-249e-460f-a47d-9e764fdb18ed]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:43 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:43 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD Jul 07 10:54:43 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 1G" returned: 0 in 0.856s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:43 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 Jul 07 10:54:43 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:43 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea Jul 07 10:54:43 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:44 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD" returned: 0 in 0.732s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:44 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2" returned: 0 in 0.713s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:44 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 is being set with open permissions: ugo+rw Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:44 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea" returned: 0 in 0.794s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:44 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD Jul 07 10:54:44 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:44 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 Jul 07 10:54:44 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:44 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 Jul 07 10:54:44 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:44 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2" returned: 0 in 0.675s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:44 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD" returned: 1 in 0.791s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:44 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.info Jul 07 10:54:44 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:44 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:44 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43 Jul 07 10:54:44 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:45 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.info" returned: 0 in 0.673s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:45 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.info is being set with open permissions: ugo+rw Jul 07 10:54:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:45 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.info Jul 07 10:54:45 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:45 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea.d12935e9-ec9d-4cfa-a186-ece74a1bab43" returned: 0 in 0.651s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-d12935e9-ec9d-4cfa-a186-ece74a1bab43" released by "_delete_snapshot" :: held 3.098s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-1d6e423f-cdcf-4744-96eb-5130e31f73ea" released by "delete_snapshot" :: held 3.126s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:45 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Created reservations ['c2c48acb-8fbc-41a5-a8b9-eafa976134c0', 'b2f5b58f-2d08-4ec9-a1ac-525266be6b34', '8c7813ae-80b1-448a-b2d8-aba1e515bee4', 'e8949791-12b2-4bfe-ba4e-5dd17815de65'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Delete snapshot completed successfully. Jul 07 10:54:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f31b2e90-875c-456b-9027-b3e768756500 tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-d12935e9-ec9d-4cfa-a186-ece74a1bab43-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:46 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.info" returned: 0 in 0.631s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.462s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.213s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot 0e75a8d2-d024-47b5-b692-31d6b09a164b of volume 253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:54:46 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-83b3b981-4d8e-4664-bb5e-fecbf1a955ee tempest-ProjectReaderTests-1999001315 None] Create snapshot completed successfully Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03b0f7-035d-4382-baec-2ecde229a982]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:46 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c Jul 07 10:54:46 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-1d6e423f-cdcf-4744-96eb-5130e31f73ea-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-1d6e423f-cdcf-4744-96eb-5130e31f73ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-quobyte-1d6e423f-cdcf-4744-96eb-5130e31f73ea" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-1d6e423f-cdcf-4744-96eb-5130e31f73ea" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad10bdb5-cecd-488f-8d48-1d21dc25666c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:46 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea Jul 07 10:54:46 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:46 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c" returned: 0 in 0.776s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:46 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b 1G Jul 07 10:54:47 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-d8425a45-ec69-4c27-868b-0a7d48029cc2-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-d8425a45-ec69-4c27-868b-0a7d48029cc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-ce318a7b-37ed-409e-aa60-7cb35abfc236" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-ce318a7b-37ed-409e-aa60-7cb35abfc236" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-d8425a45-ec69-4c27-868b-0a7d48029cc2" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-d8425a45-ec69-4c27-868b-0a7d48029cc2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Deleting offline snapshot d8425a45-ec69-4c27-868b-0a7d48029cc2 of volume ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] snapshot_file for this snap is: volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[634e2441-aac3-4282-ab79-eac0d1f3db90]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:47 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea" returned: 0 in 0.850s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:47 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea Jul 07 10:54:47 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:47 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 Jul 07 10:54:47 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:47 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b 1G" returned: 0 in 0.861s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-253a7266-c887-4984-8595-e440fe35df8c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:47 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-253a7266-c887-4984-8595-e440fe35df8c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b Jul 07 10:54:47 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:48 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-1d6e423f-cdcf-4744-96eb-5130e31f73ea" returned: 0 in 0.691s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-1d6e423f-cdcf-4744-96eb-5130e31f73ea" released by "delete_volume" :: held 1.598s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:48 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2" returned: 0 in 0.808s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce318a7b-37ed-409e-aa60-7cb35abfc236(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97a505-28f4-40cf-8f64-befaff20b252]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Created reservations ['d47ed157-c42c-46ef-9fab-13cc611c7229', '584f6d54-aa0e-4c85-b5cf-af23dc7744ec', 'e993c385-a567-4069-bfe1-5438bd60e651', '478de1a7-ff6d-4b15-a957-14fe215054e4'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:48 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-253a7266-c887-4984-8595-e440fe35df8c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b" returned: 0 in 0.697s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:48 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b is being set with open permissions: ugo+rw Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:48 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 Jul 07 10:54:48 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:48 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b Jul 07 10:54:48 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:48 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:48 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-a170b73f-edd6-489b-ae18-622ddc8aa964-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-a170b73f-edd6-489b-ae18-622ddc8aa964-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "cinder-quobyte-a170b73f-edd6-489b-ae18-622ddc8aa964" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-a170b73f-edd6-489b-ae18-622ddc8aa964" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a664bc-5516-4a7d-83ef-52c3dfccfe08]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:49 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b" returned: 0 in 0.710s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:49 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 Jul 07 10:54:49 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:49 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:49 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236" returned: 0 in 0.874s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.698s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:49 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.info Jul 07 10:54:49 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Deleted volume successfully. Jul 07 10:54:49 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 Jul 07 10:54:49 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-69223cb2-3127-4272-846a-a740cb51a81d tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-1d6e423f-cdcf-4744-96eb-5130e31f73ea-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:49 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964" returned: 0 in 0.852s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:49 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.info" returned: 0 in 0.712s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:49 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.info is being set with open permissions: ugo+rw Jul 07 10:54:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:50 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964 Jul 07 10:54:50 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:50 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.info Jul 07 10:54:50 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:50 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2" returned: 0 in 0.775s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:50 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2 Jul 07 10:54:50 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:50 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.info" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:50 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.529s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.878s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457a9f20-1e9d-4d07-8925-c1cd2963e758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039ba6d55aca4df5b18d2a6ff4406d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:41Z,use_quota=True,user_id='c81a53f102f64d889be8746be60e5ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Creating volume 457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:50 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a170b73f-edd6-489b-ae18-622ddc8aa964" returned: 0 in 0.753s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:50 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 1073741824 Jul 07 10:54:50 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-quobyte-a170b73f-edd6-489b-ae18-622ddc8aa964" released by "delete_volume" :: held 1.669s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1e1fff21-077a-40ff-9899-78e49f96a26f tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:54:50 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236.d8425a45-ec69-4c27-868b-0a7d48029cc2" returned: 0 in 0.720s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-d8425a45-ec69-4c27-868b-0a7d48029cc2" released by "_delete_snapshot" :: held 3.278s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-ce318a7b-37ed-409e-aa60-7cb35abfc236" released by "delete_snapshot" :: held 3.301s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Created reservations ['843e3cd2-4738-4a74-bef9-233470d4be3c', '3229c1b1-c265-4067-9bbd-f22708507ad1', 'eeacde0d-1521-45a0-a79e-6b3d2385d280', '807b5d12-1da9-4e30-8578-5fbde169b00d'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:50 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Created reservations ['95e7f244-b6bc-4a82-8510-669264627701', '42f6a1ac-c2cd-466b-a593-1c69e378a653', '0553864d-4378-40e2-b447-6f83d3557e30', 'cc05c799-4f44-4d83-a867-95db403adbec'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:50 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:50 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Delete snapshot completed successfully. Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ccbf3eaf-b4d1-4a86-8bb5-3e2a2a84b8b5 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-d8425a45-ec69-4c27-868b-0a7d48029cc2-delete_snapshot" released by "delete_snapshot" :: held 3.496s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:51 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 1073741824" returned: 0 in 0.861s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:51 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.729s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:51 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 Jul 07 10:54:51 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:51 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Deleted volume successfully. Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-32259fc2-6607-47de-9344-49b81f49f20e tempest-VolumeDependencyTests-1730425483 None] Lock "cinder-a170b73f-edd6-489b-ae18-622ddc8aa964-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-ce318a7b-37ed-409e-aa60-7cb35abfc236-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-ce318a7b-37ed-409e-aa60-7cb35abfc236-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-0e75a8d2-d024-47b5-b692-31d6b09a164b-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-ce318a7b-37ed-409e-aa60-7cb35abfc236" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-0e75a8d2-d024-47b5-b692-31d6b09a164b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-253a7266-c887-4984-8595-e440fe35df8c" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-ce318a7b-37ed-409e-aa60-7cb35abfc236" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-253a7266-c887-4984-8595-e440fe35df8c" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-0e75a8d2-d024-47b5-b692-31d6b09a164b" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[92043259-1887-4710-9289-3fc5c31f7d37]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-0e75a8d2-d024-47b5-b692-31d6b09a164b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot 0e75a8d2-d024-47b5-b692-31d6b09a164b of volume 253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9130cb2-ca92-4b15-86c6-cba2492d061f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:52 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 Jul 07 10:54:52 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:52 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b Jul 07 10:54:52 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:52 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758" returned: 0 in 0.819s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Attempting download of 764e0143-fd15-465a-b701-fd4f2cad184e ((None, [{'url': 'file:///opt/stack/data/glance/images/764e0143-fd15-465a-b701-fd4f2cad184e', 'metadata': {}}])) to volume 457a9f20-1e9d-4d07-8925-c1cd2963e758. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dae6042-e92e-454b-8b42-711589c5e4f4]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e0143-fd15-465a-b701-fd4f2cad184e_2wllc2hk {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:52 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e0143-fd15-465a-b701-fd4f2cad184e_2wllc2hk Jul 07 10:54:52 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:52 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236" returned: 0 in 0.976s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:52 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236 Jul 07 10:54:52 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:53 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b" returned: 0 in 1.053s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-253a7266-c887-4984-8595-e440fe35df8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[85818770-5036-460c-b24b-44831366a1fc]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:53 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c Jul 07 10:54:53 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:53 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_764e0143-fd15-465a-b701-fd4f2cad184e_2wllc2hk" returned: 0 in 1.013s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e0143-fd15-465a-b701-fd4f2cad184e_2wllc2hk {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:53 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-ce318a7b-37ed-409e-aa60-7cb35abfc236" returned: 0 in 0.740s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:53 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e0143-fd15-465a-b701-fd4f2cad184e_2wllc2hk Jul 07 10:54:53 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-ce318a7b-37ed-409e-aa60-7cb35abfc236" released by "delete_volume" :: held 1.813s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Created reservations ['94235a74-acfe-4ebd-b078-2195b355c617', '5c848b48-9895-425a-967b-4304513ddff8', '1c2f6822-3c07-4c17-b1c2-c1c4f63e0e20', '4d567ea5-d18f-4267-8b4d-ac228202520d'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:53 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:53 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:54 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c" returned: 0 in 0.910s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:54 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b Jul 07 10:54:54 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:54 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e0143-fd15-465a-b701-fd4f2cad184e_2wllc2hk" returned: 1 in 1.046s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_764e0143-fd15-465a-b701-fd4f2cad184e_2wllc2hk' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750e1e8-86ef-4d29-8731-4032394fab59]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:54 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD Jul 07 10:54:54 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:54 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.910s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:54 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Deleted volume successfully. Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (fc7d91ee-0d85-4bcd-a7b0-844bd846c4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab093b8-41e9-4ba6-964e-0c103bb81818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-c876b841-a6c8-4465-ad64-ccf56a2b6535 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-ce318a7b-37ed-409e-aa60-7cb35abfc236-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab093b8-41e9-4ba6-964e-0c103bb81818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225217773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0b84ef-8773-464a-be78-94730fe9a795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:55Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35893b33-6966-4326-9346-729fb9c58045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35893b33-6966-4326-9346-729fb9c58045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5f5615-5a10-4ca8-87ae-ed42a2bbe5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5f5615-5a10-4ca8-87ae-ed42a2bbe5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0b84ef-8773-464a-be78-94730fe9a795', 'volume_name': 'volume-3c0b84ef-8773-464a-be78-94730fe9a795', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27168866-56b2-4760-900c-ee3d763687ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27168866-56b2-4760-900c-ee3d763687ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6752bfdb-e188-434b-95c4-2de81644f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:54 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Volume 3c0b84ef-8773-464a-be78-94730fe9a795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0b84ef-8773-464a-be78-94730fe9a795', 'volume_size': 1} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225217773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0b84ef-8773-464a-be78-94730fe9a795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:55Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Creating volume 3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:54 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:54 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 1073741824 Jul 07 10:54:54 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Flow 'volume_create_manager' (9fd3dcf9-22ac-469c-9458-f492ed626e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dd084b-5c84-4fad-b934-c5205304ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dd084b-5c84-4fad-b934-c5205304ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fe2c3c-fbfb-44d2-af11-60e719d6cf91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547282a54fe242a2915d2570acc04158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:55Z,use_quota=True,user_id='51c4b434c8374a238da05217bbc483b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6391eaa-843c-43ec-a6a9-05f3cd606055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6391eaa-843c-43ec-a6a9-05f3cd606055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:55 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ae0b39-ed95-4081-8c7a-279255866b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ae0b39-ed95-4081-8c7a-279255866b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72fe2c3c-fbfb-44d2-af11-60e719d6cf91', 'volume_name': 'volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f0bf69-9f68-4ed3-90ae-53e5a639d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f0bf69-9f68-4ed3-90ae-53e5a639d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d886dd30-c4f6-487e-aa7b-b8d802ed30a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:55 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Volume 72fe2c3c-fbfb-44d2-af11-60e719d6cf91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91', 'volume_size': 1} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b" returned: 0 in 1.137s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:55 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b Jul 07 10:54:55 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:55 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD" returned: 0 in 0.921s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:55 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD Jul 07 10:54:55 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:55 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 1073741824" returned: 0 in 0.932s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:55 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c.0e75a8d2-d024-47b5-b692-31d6b09a164b" returned: 0 in 0.678s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-0e75a8d2-d024-47b5-b692-31d6b09a164b" released by "_delete_snapshot" :: held 3.913s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-253a7266-c887-4984-8595-e440fe35df8c" released by "delete_snapshot" :: held 3.965s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:55 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 Jul 07 10:54:55 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:55 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Created reservations ['e97a4b83-a293-4ba0-83ba-761787ddc4fe', '56f37621-46c1-4130-9b52-b63c939fb517', 'b90a4e37-d28a-4bf0-9465-672acefd20eb', '94aaabed-1d27-4659-be97-3c36704c5ce1'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-3ced1807-1b08-4495-9f10-f28be0a2b8b9 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-0e75a8d2-d024-47b5-b692-31d6b09a164b-delete_snapshot" released by "delete_snapshot" :: held 4.164s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-253a7266-c887-4984-8595-e440fe35df8c-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-253a7266-c887-4984-8595-e440fe35df8c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:56 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD" returned: 1 in 0.791s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] 764e0143-fd15-465a-b701-fd4f2cad184e was raw, converting to raw {{(pid=87208) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-253a7266-c887-4984-8595-e440fe35df8c" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:54:56 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 Jul 07 10:54:56 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-253a7266-c887-4984-8595-e440fe35df8c" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b579e50-c037-43ea-bb4c-6b8fcd7dbef0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:56 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c Jul 07 10:54:56 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:56 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fe2c3c-fbfb-44d2-af11-60e719d6cf91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547282a54fe242a2915d2570acc04158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:55Z,use_quota=True,user_id='51c4b434c8374a238da05217bbc483b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Creating volume 72fe2c3c-fbfb-44d2-af11-60e719d6cf91 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:54:56 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:56 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 1073741824 Jul 07 10:54:56 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6752bfdb-e188-434b-95c4-2de81644f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0b84ef-8773-464a-be78-94730fe9a795', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ac1cd3-0e13-4efb-90cc-8bd1a3eca184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:56 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Volume volume-3c0b84ef-8773-464a-be78-94730fe9a795 (3c0b84ef-8773-464a-be78-94730fe9a795): created successfully Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ac1cd3-0e13-4efb-90cc-8bd1a3eca184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (fc7d91ee-0d85-4bcd-a7b0-844bd846c4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-21406e14-a9c6-4819-bb04-c5452bf9a232 tempest-ProjectReaderTests-1999001315 None] Created volume successfully. Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:57 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_764e0143-fd15-465a-b701-fd4f2cad184e_ysjxt9m1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:54:57 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:57 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 1G Jul 07 10:54:57 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:57 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c" returned: 0 in 0.945s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:57 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c Jul 07 10:54:57 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:57 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 1073741824" returned: 0 in 0.970s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:57 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 Jul 07 10:54:57 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:57 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 1G" returned: 0 in 0.739s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5135d2f7-1e00-4ea0-8e88-e2f1add1b813]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:58 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-253a7266-c887-4984-8595-e440fe35df8c" returned: 0 in 0.718s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-253a7266-c887-4984-8595-e440fe35df8c" released by "delete_volume" :: held 1.721s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:58 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 Jul 07 10:54:58 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Created reservations ['5a51a50d-5e73-4c63-a2ad-2980dc8dbc6a', '66639d93-7016-41d9-8a4a-f742447eec3a', '849183d1-1da7-41f9-906f-e6758425db7e', '87c77911-2c47-4894-a045-8a92b90361a6'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:58 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:54:58 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:58 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91" returned: 0 in 0.693s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.164s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d886dd30-c4f6-487e-aa7b-b8d802ed30a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2b1b31-5c27-4f60-a225-c54c02bf24a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Creating offline snapshot 6bd47980-557c-4b25-b2bb-c4f74f80c867 of volume 3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:54:58 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Volume volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 (72fe2c3c-fbfb-44d2-af11-60e719d6cf91): created successfully Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2b1b31-5c27-4f60-a225-c54c02bf24a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Flow 'volume_create_manager' (9fd3dcf9-22ac-469c-9458-f492ed626e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[854425ae-b969-424a-ad43-3cc6a62c45a0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-80ad8ef4-d3e5-4013-beb3-36143777840d tempest-CinderUnicodeTest-1646603009 None] Created volume successfully. Jul 07 10:54:58 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 Jul 07 10:54:58 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:58 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758" returned: 0 in 0.909s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:58 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.749s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:54:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:59 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 Jul 07 10:54:59 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (1e3a6339-e850-4b30-821c-44dfb6c46d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7d4921-1a30-41b3-97b1-5e961ac4d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-017dc6bb-9f7f-4605-b5e1-cd930d679b93 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-253a7266-c887-4984-8595-e440fe35df8c-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7d4921-1a30-41b3-97b1-5e961ac4d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105822748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b329c8-fc25-44fa-a74d-b9fb1402389c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:59Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2065923a-9247-4c9b-8145-723455f0f674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2065923a-9247-4c9b-8145-723455f0f674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3701a86e-d819-4006-ac74-211d7368e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3701a86e-d819-4006-ac74-211d7368e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b329c8-fc25-44fa-a74d-b9fb1402389c', 'volume_name': 'volume-12b329c8-fc25-44fa-a74d-b9fb1402389c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4befaaa4-4ea6-4045-a5b0-699ee31a9786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4befaaa4-4ea6-4045-a5b0-699ee31a9786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fbe3b1-3c70-4ca3-907f-10f4af08fa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Volume 12b329c8-fc25-44fa-a74d-b9fb1402389c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b329c8-fc25-44fa-a74d-b9fb1402389c', 'volume_size': 1} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:54:59 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795" returned: 0 in 0.936s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:54:59 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 1G Jul 07 10:54:59 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:54:59 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758" returned: 1 in 0.820s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Downloaded image 764e0143-fd15-465a-b701-fd4f2cad184e ((None, [{'url': 'file:///opt/stack/data/glance/images/764e0143-fd15-465a-b701-fd4f2cad184e', 'metadata': {}}])) to volume 457a9f20-1e9d-4d07-8925-c1cd2963e758 successfully. {{(pid=87208) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Temporary image 764e0143-fd15-465a-b701-fd4f2cad184e for user c81a53f102f64d889be8746be60e5ea6 is deleted. {{(pid=87208) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.volume_utils [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Marking volume 457a9f20-1e9d-4d07-8925-c1cd2963e758 as bootable. {{(pid=87208) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Copying metadata from image 764e0143-fd15-465a-b701-fd4f2cad184e to 457a9f20-1e9d-4d07-8925-c1cd2963e758. {{(pid=87208) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Creating volume glance metadata for volume 457a9f20-1e9d-4d07-8925-c1cd2963e758 backed by image 764e0143-fd15-465a-b701-fd4f2cad184e with: {'image_id': '764e0143-fd15-465a-b701-fd4f2cad184e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a469bbf0ce4ae64082d93702bdcc6406', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87208) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc32d93-21b7-46d4-90ff-7c6a01081181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457a9f20-1e9d-4d07-8925-c1cd2963e758', 'volume_size': 1, 'image_id': '764e0143-fd15-465a-b701-fd4f2cad184e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/764e0143-fd15-465a-b701-fd4f2cad184e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a469bbf0ce4ae64082d93702bdcc6406', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '039ba6d55aca4df5b18d2a6ff4406d48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b81b163425ea1f0afd9b713edeecdc71be0c0872b1b5d577907c04402d184bf1b44ffa1bb76574db7486f626d115d5c7218599218873323dfafdc451afb8a784', 'id': '764e0143-fd15-465a-b701-fd4f2cad184e', 'created_at': datetime.datetime(2026, 7, 7, 8, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 8, 54, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/764e0143-fd15-465a-b701-fd4f2cad184e/file', 'properties': {}}, 'image_service': }' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59dacef1-b797-49ab-95c2-eb63e9ba3ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Volume volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 (457a9f20-1e9d-4d07-8925-c1cd2963e758): created successfully Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59dacef1-b797-49ab-95c2-eb63e9ba3ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Flow 'volume_create_manager' (efbe3726-8c4c-4be9-a5ef-14bd923e0cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-82085faf-c140-4a16-b8d2-d3da5ab9b45c tempest-VolumeImageDependencyTests-174545993 None] Created volume successfully. Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Flow 'volume_create_manager' (551acde7-37df-41b0-90f0-edd38f477607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542fe774-a509-457e-befd-df321891a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542fe774-a509-457e-befd-df321891a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-466202141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4375e7ed-8aae-403b-b45f-eca84d59e41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547282a54fe242a2915d2570acc04158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:00Z,use_quota=True,user_id='51c4b434c8374a238da05217bbc483b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827c7245-753f-4087-b2d7-a08d994d8da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827c7245-753f-4087-b2d7-a08d994d8da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e723c0c9-629e-4ea8-b3f0-4187bd48200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e723c0c9-629e-4ea8-b3f0-4187bd48200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4375e7ed-8aae-403b-b45f-eca84d59e41b', 'volume_name': 'volume-4375e7ed-8aae-403b-b45f-eca84d59e41b', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fca8567-5210-47a1-ac61-c879b20c9f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fca8567-5210-47a1-ac61-c879b20c9f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e2e363-b529-41c0-b36d-79173c485bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:54:59 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Volume 4375e7ed-8aae-403b-b45f-eca84d59e41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4375e7ed-8aae-403b-b45f-eca84d59e41b', 'volume_size': 1} Jul 07 10:54:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:00 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 1G" returned: 0 in 0.899s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0b84ef-8773-464a-be78-94730fe9a795 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:00 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0b84ef-8773-464a-be78-94730fe9a795 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 Jul 07 10:55:00 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Acquiring lock "cinder-457a9f20-1e9d-4d07-8925-c1cd2963e758-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Lock "cinder-457a9f20-1e9d-4d07-8925-c1cd2963e758-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Acquiring lock "cinder-quobyte-457a9f20-1e9d-4d07-8925-c1cd2963e758" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Lock "cinder-quobyte-457a9f20-1e9d-4d07-8925-c1cd2963e758" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae7e06-7bcd-49b2-a560-59571ec1b438]: (4, 'raw') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:00 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 Jul 07 10:55:00 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:00 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0b84ef-8773-464a-be78-94730fe9a795 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867" returned: 0 in 0.733s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:00 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 is being set with open permissions: ugo+rw Jul 07 10:55:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:00 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 Jul 07 10:55:00 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:01 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758" returned: 0 in 0.774s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:01 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867" returned: 0 in 0.650s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:01 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.info Jul 07 10:55:01 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:01 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 Jul 07 10:55:01 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:02 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.info" returned: 0 in 0.656s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:02 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.info is being set with open permissions: ugo+rw Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:02 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.info Jul 07 10:55:02 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:02 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758" returned: 1 in 0.789s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758' failed. Not Retrying. {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:02 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758 Jul 07 10:55:02 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:02 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.info" returned: 0 in 0.646s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.650s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.847s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105822748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b329c8-fc25-44fa-a74d-b9fb1402389c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:54:59Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Creating volume 12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:02 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:03 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c 1073741824 Jul 07 10:55:03 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3f66b2ec-ff75-4732-9c99-376356b4f785 tempest-ProjectReaderTests-1999001315 None] Create snapshot completed successfully Jul 07 10:55:03 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-457a9f20-1e9d-4d07-8925-c1cd2963e758" returned: 0 in 0.695s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Lock "cinder-quobyte-457a9f20-1e9d-4d07-8925-c1cd2963e758" released by "delete_volume" :: held 2.338s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Created reservations ['014b7041-4e7d-49bf-9c38-f55da6758ff6', '0922b325-f2e0-4c69-a691-5a387153a9e8', '9c318b56-746a-4de5-8c18-41b32fade472', 'a80ec2eb-84db-4b1e-8dc6-3186c2989eec'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:03 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:03 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-6bd47980-557c-4b25-b2bb-c4f74f80c867-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-6bd47980-557c-4b25-b2bb-c4f74f80c867-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-3c0b84ef-8773-464a-be78-94730fe9a795" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-3c0b84ef-8773-464a-be78-94730fe9a795" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-6bd47980-557c-4b25-b2bb-c4f74f80c867" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-6bd47980-557c-4b25-b2bb-c4f74f80c867" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Deleting offline snapshot 6bd47980-557c-4b25-b2bb-c4f74f80c867 of volume 3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] snapshot_file for this snap is: volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[186cf2c0-84e5-4180-9b89-1c9ca97dd996]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:03 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 Jul 07 10:55:03 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:03 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.658s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Deleted volume successfully. Jul 07 10:55:03 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c 1073741824" returned: 0 in 0.897s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1f55fa49-5047-41c7-a082-46acdd899483 tempest-VolumeImageDependencyTests-174545993 None] Lock "cinder-457a9f20-1e9d-4d07-8925-c1cd2963e758-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:03 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c Jul 07 10:55:03 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:04 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867" returned: 0 in 0.880s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c0b84ef-8773-464a-be78-94730fe9a795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a671751-2311-4d6b-be65-b47affe71a01]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:04 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 Jul 07 10:55:04 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:04 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c" returned: 0 in 0.702s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.667s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-466202141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4375e7ed-8aae-403b-b45f-eca84d59e41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547282a54fe242a2915d2570acc04158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:00Z,use_quota=True,user_id='51c4b434c8374a238da05217bbc483b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Creating volume 4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:04 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:04 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b 1073741824 Jul 07 10:55:04 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fbe3b1-3c70-4ca3-907f-10f4af08fa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b329c8-fc25-44fa-a74d-b9fb1402389c', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc43e700-da33-4c77-860c-54bd9d4a8d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:04 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Volume volume-12b329c8-fc25-44fa-a74d-b9fb1402389c (12b329c8-fc25-44fa-a74d-b9fb1402389c): created successfully Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc43e700-da33-4c77-860c-54bd9d4a8d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:04 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (1e3a6339-e850-4b30-821c-44dfb6c46d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:04 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c4d6f801-d2c8-4104-8bd3-d7464415a33b tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:55:05 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795" returned: 0 in 0.990s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:05 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 Jul 07 10:55:05 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:05 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b 1073741824" returned: 0 in 1.181s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:05 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b Jul 07 10:55:05 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:06 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867" returned: 0 in 0.921s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:06 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867 Jul 07 10:55:06 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:06 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b" returned: 0 in 0.741s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.068s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot b73f2b1a-405a-4eb9-a814-5a052be15ecd of volume 12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e2e363-b529-41c0-b36d-79173c485bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4375e7ed-8aae-403b-b45f-eca84d59e41b', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5999c0-a6a7-494c-a4b2-ff1b3da953f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4e93a8-1e77-4b94-8755-9079c5f02860]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:06 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Volume volume-4375e7ed-8aae-403b-b45f-eca84d59e41b (4375e7ed-8aae-403b-b45f-eca84d59e41b): created successfully Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5999c0-a6a7-494c-a4b2-ff1b3da953f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:06 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Flow 'volume_create_manager' (551acde7-37df-41b0-90f0-edd38f477607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:06 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-984e7df1-a343-4cd9-8f4a-e5a7a4a8a581 tempest-CinderUnicodeTest-1646603009 None] Created volume successfully. Jul 07 10:55:06 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c Jul 07 10:55:06 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:07 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795.6bd47980-557c-4b25-b2bb-c4f74f80c867" returned: 0 in 0.718s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-6bd47980-557c-4b25-b2bb-c4f74f80c867" released by "_delete_snapshot" :: held 3.622s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-3c0b84ef-8773-464a-be78-94730fe9a795" released by "delete_snapshot" :: held 3.652s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Created reservations ['9b469c0f-d78c-45cb-bed9-8f22c22fdab0', '2be371d2-2977-41ca-af4b-0846d514d542', '2b2d223e-c54b-486e-849d-7bbfa7d7babb', 'c9506317-18f9-4310-9838-0530682d28c7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Delete snapshot completed successfully. Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-91016cb2-0d2f-4a3e-b641-e8798aeccbe7 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-6bd47980-557c-4b25-b2bb-c4f74f80c867-delete_snapshot" released by "delete_snapshot" :: held 3.803s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:07 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c" returned: 0 in 0.808s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:07 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd 1G Jul 07 10:55:07 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-3c0b84ef-8773-464a-be78-94730fe9a795-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-3c0b84ef-8773-464a-be78-94730fe9a795-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-3c0b84ef-8773-464a-be78-94730fe9a795" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-3c0b84ef-8773-464a-be78-94730fe9a795" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1844339-9978-4952-b122-9c3b0dda7d1e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:08 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 Jul 07 10:55:08 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:08 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd 1G" returned: 0 in 0.913s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b329c8-fc25-44fa-a74d-b9fb1402389c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:08 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b329c8-fc25-44fa-a74d-b9fb1402389c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd Jul 07 10:55:08 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:08 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795" returned: 0 in 0.832s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:08 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795 Jul 07 10:55:08 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:09 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b329c8-fc25-44fa-a74d-b9fb1402389c -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd" returned: 0 in 0.706s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:09 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd is being set with open permissions: ugo+rw Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:09 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd Jul 07 10:55:09 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:09 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3c0b84ef-8773-464a-be78-94730fe9a795" returned: 0 in 0.686s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-3c0b84ef-8773-464a-be78-94730fe9a795" released by "delete_volume" :: held 1.604s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Created reservations ['d9f19a88-66a5-4ec5-b3fc-ccacbe50871c', '3ad006a5-e0ee-4760-95e2-60b0a7b07493', '46e52103-ab52-4b13-8540-87cdfdec405e', '2076cb8c-e67c-44d6-9438-bddd49af355f'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:09 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:09 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:09 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd" returned: 0 in 0.684s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:09 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.info Jul 07 10:55:09 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:10 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.905s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:10 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Deleted volume successfully. Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-bcd03857-3875-4190-8dfc-84dea9bf6889 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-3c0b84ef-8773-464a-be78-94730fe9a795-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:10 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.info" returned: 0 in 0.911s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:10 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.info is being set with open permissions: ugo+rw Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:10 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.info Jul 07 10:55:10 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (d4e0a643-e45d-4071-b1d6-4312708313a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379f7d38-8ad4-4ebb-8c0e-d0a092cafbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379f7d38-8ad4-4ebb-8c0e-d0a092cafbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807046442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83bd57d-795f-4d9c-83b3-461dad56c0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:11Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7f3cb0-e997-4840-a9af-8eff8d3bea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7f3cb0-e997-4840-a9af-8eff8d3bea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabde632-08e4-417b-b8de-453314e39334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabde632-08e4-417b-b8de-453314e39334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83bd57d-795f-4d9c-83b3-461dad56c0bb', 'volume_name': 'volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:10 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9298db-aea3-40b8-9264-6c57e854a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9298db-aea3-40b8-9264-6c57e854a401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416fbef9-2a78-428a-ad33-80ea3d6626a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Volume d83bd57d-795f-4d9c-83b3-461dad56c0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb', 'volume_size': 1} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:11 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.info" returned: 0 in 0.670s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.789s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.678s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Creating offline snapshot 1bd76d86-c22e-44fa-99df-93b0e87644b5 of volume 4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[471e32f1-0293-47b9-bf9b-ce35c9f6b3c3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-57c9eb91-b173-4a0e-9f9e-04172369bfd9 tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:55:11 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b Jul 07 10:55:11 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-b73f2b1a-405a-4eb9-a814-5a052be15ecd-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-b73f2b1a-405a-4eb9-a814-5a052be15ecd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-12b329c8-fc25-44fa-a74d-b9fb1402389c" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-12b329c8-fc25-44fa-a74d-b9fb1402389c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-b73f2b1a-405a-4eb9-a814-5a052be15ecd" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-b73f2b1a-405a-4eb9-a814-5a052be15ecd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot b73f2b1a-405a-4eb9-a814-5a052be15ecd of volume 12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f54710-5f87-4119-94b4-56df4a6a1057]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:12 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd Jul 07 10:55:12 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:12 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b" returned: 0 in 0.860s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:12 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 1G Jul 07 10:55:12 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:12 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd" returned: 0 in 0.845s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:12 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b329c8-fc25-44fa-a74d-b9fb1402389c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:12 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[839b7277-c8b5-41b3-8ec4-46d4142e5b5f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:13 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c Jul 07 10:55:13 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:13 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 1G" returned: 0 in 0.886s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4375e7ed-8aae-403b-b45f-eca84d59e41b -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:13 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4375e7ed-8aae-403b-b45f-eca84d59e41b -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 Jul 07 10:55:13 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:13 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c" returned: 0 in 0.813s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:13 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd Jul 07 10:55:13 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:13 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4375e7ed-8aae-403b-b45f-eca84d59e41b -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5" returned: 0 in 0.701s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:13 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 is being set with open permissions: ugo+rw Jul 07 10:55:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:13 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 Jul 07 10:55:13 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:14 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd" returned: 0 in 0.802s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:14 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd Jul 07 10:55:14 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:14 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5" returned: 0 in 0.709s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:14 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.info Jul 07 10:55:14 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:15 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c.b73f2b1a-405a-4eb9-a814-5a052be15ecd" returned: 0 in 0.719s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-b73f2b1a-405a-4eb9-a814-5a052be15ecd" released by "_delete_snapshot" :: held 3.306s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-12b329c8-fc25-44fa-a74d-b9fb1402389c" released by "delete_snapshot" :: held 3.337s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:15 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Created reservations ['c7df29dc-9866-4689-8966-2692e978da1a', '41bb5a43-0a86-4bf2-a00f-547be18052e5', 'b4272d85-3dcb-4537-8f3a-2112d3b72eb2', '20bb615b-ad98-4dd5-afbd-77b0c468bf66'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:15 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:55:15 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fec55773-0bc0-4e70-9ae0-7408c84fb98e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-b73f2b1a-405a-4eb9-a814-5a052be15ecd-delete_snapshot" released by "delete_snapshot" :: held 3.473s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:15 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.info" returned: 0 in 0.725s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:15 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.info is being set with open permissions: ugo+rw Jul 07 10:55:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:15 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.info Jul 07 10:55:15 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:16 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.info" returned: 0 in 0.671s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.689s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.112s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807046442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83bd57d-795f-4d9c-83b3-461dad56c0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:11Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Creating volume d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:16 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-12b329c8-fc25-44fa-a74d-b9fb1402389c-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:16 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb 1073741824 Jul 07 10:55:16 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-12b329c8-fc25-44fa-a74d-b9fb1402389c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:16 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a246770d-4c7b-4e4d-b808-5d3ebc74db1d tempest-CinderUnicodeTest-1646603009 None] Create snapshot completed successfully Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-12b329c8-fc25-44fa-a74d-b9fb1402389c" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-12b329c8-fc25-44fa-a74d-b9fb1402389c" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c28cb3-8aa0-4a93-ab2b-7c4523a33073]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:16 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c Jul 07 10:55:16 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:17 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb 1073741824" returned: 0 in 0.916s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:17 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c" returned: 0 in 0.795s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:17 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c Jul 07 10:55:17 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:17 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "cinder-1bd76d86-c22e-44fa-99df-93b0e87644b5-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:17 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-1bd76d86-c22e-44fa-99df-93b0e87644b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "cinder-quobyte-4375e7ed-8aae-403b-b45f-eca84d59e41b" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-4375e7ed-8aae-403b-b45f-eca84d59e41b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "cinder-quobyte-1bd76d86-c22e-44fa-99df-93b0e87644b5" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-1bd76d86-c22e-44fa-99df-93b0e87644b5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Deleting offline snapshot 1bd76d86-c22e-44fa-99df-93b0e87644b5 of volume 4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] snapshot_file for this snap is: volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f926e00-61cb-44ac-bf0d-9a7c304a581f]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:17 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 Jul 07 10:55:17 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:17 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-12b329c8-fc25-44fa-a74d-b9fb1402389c" returned: 0 in 0.665s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-12b329c8-fc25-44fa-a74d-b9fb1402389c" released by "delete_volume" :: held 1.537s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Created reservations ['53e5d945-79ca-4392-b642-f2f842179a1a', '50f31c19-69b1-4123-b95d-9c0955ebb242', 'ca2c8976-992c-4ac1-b297-ea7ec8aa3e0e', '5c1e6f2d-3a8f-4435-9e7f-3fc641447c82'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:17 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb" returned: 0 in 0.780s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416fbef9-2a78-428a-ad33-80ea3d6626a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa74935-dadd-4cac-8515-f3335f303ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:17 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Volume volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb (d83bd57d-795f-4d9c-83b3-461dad56c0bb): created successfully Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa74935-dadd-4cac-8515-f3335f303ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:17 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (d4e0a643-e45d-4071-b1d6-4312708313a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:17 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c6f75dc0-bcc2-4558-b61c-92f17639812e tempest-ProjectReaderTests-1999001315 None] Created volume successfully. Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:18 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:18 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:18 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5" returned: 0 in 0.832s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4375e7ed-8aae-403b-b45f-eca84d59e41b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d38ad-358c-4398-ab25-4d0af680d3bd]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:18 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b Jul 07 10:55:18 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Creating offline snapshot cbac029c-3cd7-42df-93bf-ee9b82fb181b of volume d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[383630f8-6e9e-4b6d-943d-57fd615cdb55]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:18 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb Jul 07 10:55:18 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:18 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.907s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:18 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:55:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-d825d449-5e19-4d6d-b2a4-827348a0003f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-12b329c8-fc25-44fa-a74d-b9fb1402389c-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (5c86c5b1-a9d4-4c53-9639-cb5210aeff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60eb83ab-1696-4bcd-89a3-3065e6273e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60eb83ab-1696-4bcd-89a3-3065e6273e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103996346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a9cd60-d514-4a68-acac-1d978b435fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:19Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc8f76d-0ff2-4b7e-9283-afe959518c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc8f76d-0ff2-4b7e-9283-afe959518c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0fd4d7-fd86-45e5-9814-4add944fccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0fd4d7-fd86-45e5-9814-4add944fccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a9cd60-d514-4a68-acac-1d978b435fc8', 'volume_name': 'volume-40a9cd60-d514-4a68-acac-1d978b435fc8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407f585c-b51c-4c34-8e1f-a3df88960c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407f585c-b51c-4c34-8e1f-a3df88960c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa6b1c1-ab2b-4aa6-9b6a-6c80945fbf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:19 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Volume 40a9cd60-d514-4a68-acac-1d978b435fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a9cd60-d514-4a68-acac-1d978b435fc8', 'volume_size': 1} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:19 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b" returned: 0 in 1.036s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:19 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 Jul 07 10:55:19 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:19 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb" returned: 0 in 1.076s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:19 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b 1G Jul 07 10:55:19 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:20 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5" returned: 0 in 0.849s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:20 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5 Jul 07 10:55:20 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:20 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b 1G" returned: 0 in 0.874s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:20 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b Jul 07 10:55:20 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:20 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b.1bd76d86-c22e-44fa-99df-93b0e87644b5" returned: 0 in 0.726s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-1bd76d86-c22e-44fa-99df-93b0e87644b5" released by "_delete_snapshot" :: held 3.588s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-4375e7ed-8aae-403b-b45f-eca84d59e41b" released by "delete_snapshot" :: held 3.613s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Created reservations ['56202f2d-b894-45e4-a6db-520aad7cf7db', 'be7a78b9-5c93-4358-af94-d62fbb6c34a7', 'b30f7683-6d8f-450a-9889-d38133180de6', '80a978b7-a2f1-4b7a-9bf8-f0e306515a23'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:20 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Delete snapshot completed successfully. Jul 07 10:55:20 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-f4727d9b-c115-4518-979c-acb851316e09 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-1bd76d86-c22e-44fa-99df-93b0e87644b5-delete_snapshot" released by "delete_snapshot" :: held 3.775s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:21 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b" returned: 0 in 0.771s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:21 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b is being set with open permissions: ugo+rw Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:21 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b Jul 07 10:55:21 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "cinder-4375e7ed-8aae-403b-b45f-eca84d59e41b-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-4375e7ed-8aae-403b-b45f-eca84d59e41b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "cinder-quobyte-4375e7ed-8aae-403b-b45f-eca84d59e41b" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-4375e7ed-8aae-403b-b45f-eca84d59e41b" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de130d-239c-46da-ac62-73cd7d55d792]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:21 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b Jul 07 10:55:21 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:22 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b" returned: 0 in 0.715s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:22 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.info Jul 07 10:55:22 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Flow 'volume_create_manager' (60be6c38-ed30-452f-9c5f-b38e4741c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9b6fe1-ff47-4756-a029-440018e9fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9b6fe1-ff47-4756-a029-440018e9fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810873295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28ed392-8c04-4b90-b5f7-2f83ad08b7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750774a6bf224f968ecb7165249ca16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:22Z,use_quota=True,user_id='8f0ccd792dbb4212a87067531e637878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0445b10d-98c5-44c2-818e-0022adadcfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0445b10d-98c5-44c2-818e-0022adadcfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0d2329-61d4-44bf-ae8e-4360ec9b26bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0d2329-61d4-44bf-ae8e-4360ec9b26bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28ed392-8c04-4b90-b5f7-2f83ad08b7ce', 'volume_name': 'volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64790e-8bd3-4cfd-a844-0f1067169832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64790e-8bd3-4cfd-a844-0f1067169832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dfe6dd-5c9d-4a6e-a9ce-a8d7d6d0089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:22 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Volume d28ed392-8c04-4b90-b5f7-2f83ad08b7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce', 'volume_size': 1} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:22 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b" returned: 0 in 0.872s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:22 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b Jul 07 10:55:22 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:22 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.info" returned: 0 in 0.681s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:22 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.info is being set with open permissions: ugo+rw Jul 07 10:55:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:22 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.info Jul 07 10:55:22 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:23 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4375e7ed-8aae-403b-b45f-eca84d59e41b" returned: 0 in 0.656s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-4375e7ed-8aae-403b-b45f-eca84d59e41b" released by "delete_volume" :: held 1.601s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Created reservations ['35b00b17-23b9-4ef8-848e-63bb5d16e257', 'aa2910b2-9586-4c38-9252-3e21b126fc7d', 'c447d390-69be-48e8-ba99-79e655521755', '8a07ef47-35da-4524-8844-9215dd923f96'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:23 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:23 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:23 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.info" returned: 0 in 0.668s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.915s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.337s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103996346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a9cd60-d514-4a68-acac-1d978b435fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:19Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Creating volume 40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:23 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:23 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 1073741824 Jul 07 10:55:23 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-63b450be-9c09-4340-8b5d-b7a9b960ce0f tempest-ProjectReaderTests-1999001315 None] Create snapshot completed successfully Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "cinder-72fe2c3c-fbfb-44d2-af11-60e719d6cf91-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:23 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:23 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-72fe2c3c-fbfb-44d2-af11-60e719d6cf91-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "cinder-quobyte-72fe2c3c-fbfb-44d2-af11-60e719d6cf91" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-72fe2c3c-fbfb-44d2-af11-60e719d6cf91" acquired by "delete_volume" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9655a0-fdf2-437d-bb55-b33082f77d80]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-cbac029c-3cd7-42df-93bf-ee9b82fb181b-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-cbac029c-3cd7-42df-93bf-ee9b82fb181b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-d83bd57d-795f-4d9c-83b3-461dad56c0bb" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-d83bd57d-795f-4d9c-83b3-461dad56c0bb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-cbac029c-3cd7-42df-93bf-ee9b82fb181b" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-cbac029c-3cd7-42df-93bf-ee9b82fb181b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Deleting offline snapshot cbac029c-3cd7-42df-93bf-ee9b82fb181b of volume d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] snapshot_file for this snap is: volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcd61af-f1db-4ff8-b9f0-5dba9a7bbbaa]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:24 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.827s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Deleted volume successfully. Jul 07 10:55:24 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 Jul 07 10:55:24 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e7c09d3f-b723-44de-a22a-5f217dd3cdfe tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-4375e7ed-8aae-403b-b45f-eca84d59e41b-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:24 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b Jul 07 10:55:24 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:24 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 1073741824" returned: 0 in 1.033s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:24 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:24 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 Jul 07 10:55:24 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.938s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:55:24 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91" returned: 0 in 1.007s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:24 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91 Jul 07 10:55:24 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:25 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b" returned: 0 in 0.981s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[522c4fb8-6607-481f-81f0-a63ddbf856cb]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:25 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb Jul 07 10:55:25 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:25 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8" returned: 0 in 0.732s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810873295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28ed392-8c04-4b90-b5f7-2f83ad08b7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750774a6bf224f968ecb7165249ca16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:22Z,use_quota=True,user_id='8f0ccd792dbb4212a87067531e637878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Creating volume d28ed392-8c04-4b90-b5f7-2f83ad08b7ce {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:25 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa6b1c1-ab2b-4aa6-9b6a-6c80945fbf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a9cd60-d514-4a68-acac-1d978b435fc8', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a63a6-9075-4dae-952e-140944dd750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:25 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce 1073741824 Jul 07 10:55:25 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:25 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Volume volume-40a9cd60-d514-4a68-acac-1d978b435fc8 (40a9cd60-d514-4a68-acac-1d978b435fc8): created successfully Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a63a6-9075-4dae-952e-140944dd750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (5c86c5b1-a9d4-4c53-9639-cb5210aeff1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:25 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-13411af3-8d5d-4a89-b666-90d54d39cfb6 tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:55:25 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-72fe2c3c-fbfb-44d2-af11-60e719d6cf91" returned: 0 in 0.702s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-quobyte-72fe2c3c-fbfb-44d2-af11-60e719d6cf91" released by "delete_volume" :: held 1.774s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Created reservations ['4696040f-4fc2-440e-80d7-20bf6547bb6e', '0a35af3c-efef-4711-82da-3b54921b2512', '671fe208-9340-4543-970e-f80c74fafc04', '614f1d25-dd69-421a-8ed2-450a6c3e22e7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:25 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:25 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:25 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb" returned: 0 in 0.834s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:25 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b Jul 07 10:55:25 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:26 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce 1073741824" returned: 0 in 0.990s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:26 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce Jul 07 10:55:26 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:26 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.825s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Deleted volume successfully. Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8a4df4d1-c92f-41d6-a543-3a5b5ab7f3b9 tempest-CinderUnicodeTest-1646603009 None] Lock "cinder-72fe2c3c-fbfb-44d2-af11-60e719d6cf91-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:26 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b" returned: 0 in 0.976s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:26 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b Jul 07 10:55:26 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:27 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce" returned: 0 in 0.802s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.367s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dfe6dd-5c9d-4a6e-a9ce-a8d7d6d0089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced3f323-8325-4ce8-8239-ffaebe41697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot 0e9ca563-98be-45c2-b855-8c54a33cd209 of volume 40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:27 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Volume volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce (d28ed392-8c04-4b90-b5f7-2f83ad08b7ce): created successfully Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced3f323-8325-4ce8-8239-ffaebe41697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Flow 'volume_create_manager' (60be6c38-ed30-452f-9c5f-b38e4741c122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[403fc8f2-ece4-4dbd-b7ee-6af9061fb389]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c517a0d9-96b6-45a4-aabd-2dc760296ca3 tempest-ProjectReaderTests-612054726 None] Created volume successfully. Jul 07 10:55:27 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 Jul 07 10:55:27 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:27 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb.cbac029c-3cd7-42df-93bf-ee9b82fb181b" returned: 0 in 0.765s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-cbac029c-3cd7-42df-93bf-ee9b82fb181b" released by "_delete_snapshot" :: held 3.679s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-d83bd57d-795f-4d9c-83b3-461dad56c0bb" released by "delete_snapshot" :: held 3.720s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Created reservations ['2dd9345e-53a9-4b74-aeaa-335cce2d12a9', 'd7ce2da3-e71b-4ccf-b57d-dd07fd2fcc5f', '8da913f6-4fd5-4ef6-9d74-960612bb4a71', '1594040e-8d8b-414f-aae7-ff5fae3ebf88'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Delete snapshot completed successfully. Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-940cb61c-ca11-4621-a95d-717cb98444b0 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-cbac029c-3cd7-42df-93bf-ee9b82fb181b-delete_snapshot" released by "delete_snapshot" :: held 3.920s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:27 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Acquiring lock "cinder-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Lock "cinder-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Acquiring lock "cinder-quobyte-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Lock "cinder-quobyte-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c84d37-3c8d-4943-b7bf-92fd97b08e51]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:28 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8" returned: 0 in 0.955s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:28 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce Jul 07 10:55:28 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:28 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 1G Jul 07 10:55:28 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-d83bd57d-795f-4d9c-83b3-461dad56c0bb-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Lock "cinder-d83bd57d-795f-4d9c-83b3-461dad56c0bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-d83bd57d-795f-4d9c-83b3-461dad56c0bb" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-d83bd57d-795f-4d9c-83b3-461dad56c0bb" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64ac00a-7b3c-4d34-bd9c-660bc44bc10b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:28 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb Jul 07 10:55:28 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:28 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce" returned: 0 in 0.891s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:29 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce Jul 07 10:55:29 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:29 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 1G" returned: 0 in 0.969s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a9cd60-d514-4a68-acac-1d978b435fc8 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:29 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a9cd60-d514-4a68-acac-1d978b435fc8 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 Jul 07 10:55:29 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:29 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb" returned: 0 in 0.877s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:29 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb Jul 07 10:55:29 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:29 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce" returned: 0 in 0.822s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Lock "cinder-quobyte-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce" released by "delete_volume" :: held 1.769s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Created reservations ['d9fd4d9c-747f-4d4c-9c7e-7cd8d92e0489', '70ac631f-fe7d-40ce-9bfe-79db20e81004', 'b618d34a-a0ca-416c-aa1c-b33bcfe53cdc', '0f99a3d5-1c72-4a1d-b2de-e1fa6c34f58b'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:29 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a9cd60-d514-4a68-acac-1d978b435fc8 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209" returned: 0 in 0.752s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:29 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 is being set with open permissions: ugo+rw Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:29 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 Jul 07 10:55:29 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:30 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:30 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:30 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-d83bd57d-795f-4d9c-83b3-461dad56c0bb" returned: 0 in 0.833s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-d83bd57d-795f-4d9c-83b3-461dad56c0bb" released by "delete_volume" :: held 1.795s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Created reservations ['882eeea7-58e5-4119-85ad-10c993f8ae50', '5d74b183-9ef6-4bf7-b82c-22fd8782381a', 'aa080c6e-ed48-4d23-a6a0-faeb06829988', 'd91616b0-f504-44bc-83d8-2148b19e9a26'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:30 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:30 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b60576d0-57fc-4816-a875-09ae8210c9cd tempest-ProjectAdminTests-2055850452 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87208) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 10:55:30 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209" returned: 0 in 0.714s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:30 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.info Jul 07 10:55:30 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:30 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.785s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:30 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Deleted volume successfully. Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-5ba6f7e3-2819-46f3-8d91-99de62310fc5 tempest-ProjectReaderTests-612054726 None] Lock "cinder-d28ed392-8c04-4b90-b5f7-2f83ad08b7ce-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Flow 'volume_create_manager' (c875b92a-5766-4587-a5c1-10988b4ba971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0458e9-c6e8-4976-89e0-b7d45e07d7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0458e9-c6e8-4976-89e0-b7d45e07d7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152518416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774b6fab-78f6-4045-9935-d5529976c769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750774a6bf224f968ecb7165249ca16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:31Z,use_quota=True,user_id='8f0ccd792dbb4212a87067531e637878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aacc829-fdea-4d0c-b21e-53b080df1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aacc829-fdea-4d0c-b21e-53b080df1d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84035332-8e68-46f0-8bd9-7457d76061e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84035332-8e68-46f0-8bd9-7457d76061e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774b6fab-78f6-4045-9935-d5529976c769', 'volume_name': 'volume-774b6fab-78f6-4045-9935-d5529976c769', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4966817f-b933-4c62-99b1-5ad37844b7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4966817f-b933-4c62-99b1-5ad37844b7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9175e0e4-78af-41cf-9c05-29bc5c2f38fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Volume 774b6fab-78f6-4045-9935-d5529976c769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774b6fab-78f6-4045-9935-d5529976c769', 'volume_size': 1} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:31 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.887s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Deleted volume successfully. Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-de70a654-3846-4a3e-880b-578b9a0f881e tempest-ProjectReaderTests-1999001315 None] Lock "cinder-d83bd57d-795f-4d9c-83b3-461dad56c0bb-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (694f48ae-5837-4999-8b64-38dd819d6f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aae3692-c37e-4fc9-b749-442747b3e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aae3692-c37e-4fc9-b749-442747b3e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258873599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50a33bf-d64d-467b-bd5d-e7904b2bffd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:31Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605bc342-cb2b-4afd-ac8b-f9c9c765aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605bc342-cb2b-4afd-ac8b-f9c9c765aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d828b0-d157-484d-a3db-1864fd132e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d828b0-d157-484d-a3db-1864fd132e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50a33bf-d64d-467b-bd5d-e7904b2bffd0', 'volume_name': 'volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07460779-1670-4c1e-b4ad-28a8c33b5a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07460779-1670-4c1e-b4ad-28a8c33b5a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccd182b-1b0f-4268-aa0d-297bde256bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:31 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Volume b50a33bf-d64d-467b-bd5d-e7904b2bffd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0', 'volume_size': 1} Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:31 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.info" returned: 0 in 0.883s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:31 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.info is being set with open permissions: ugo+rw Jul 07 10:55:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:31 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.info Jul 07 10:55:31 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:32 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.info" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.101s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152518416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774b6fab-78f6-4045-9935-d5529976c769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750774a6bf224f968ecb7165249ca16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:31Z,use_quota=True,user_id='8f0ccd792dbb4212a87067531e637878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Creating volume 774b6fab-78f6-4045-9935-d5529976c769 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:32 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:32 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 1073741824 Jul 07 10:55:32 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:32 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-eb064da0-c08e-4224-a74e-3abe1698b1ec tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-0e9ca563-98be-45c2-b855-8c54a33cd209-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Lock "cinder-0e9ca563-98be-45c2-b855-8c54a33cd209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-40a9cd60-d514-4a68-acac-1d978b435fc8" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40a9cd60-d514-4a68-acac-1d978b435fc8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-0e9ca563-98be-45c2-b855-8c54a33cd209" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:33 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 1073741824" returned: 0 in 0.884s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-0e9ca563-98be-45c2-b855-8c54a33cd209" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot 0e9ca563-98be-45c2-b855-8c54a33cd209 of volume 40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f48cd5-1584-4b16-a8c1-4bda2336f16d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:33 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 Jul 07 10:55:33 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:33 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 Jul 07 10:55:33 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:33 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769" returned: 0 in 0.734s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.644s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258873599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50a33bf-d64d-467b-bd5d-e7904b2bffd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:31Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Creating volume b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:34 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:34 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209" returned: 0 in 0.810s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40a9cd60-d514-4a68-acac-1d978b435fc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:34 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 1073741824 Jul 07 10:55:34 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9175e0e4-78af-41cf-9c05-29bc5c2f38fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774b6fab-78f6-4045-9935-d5529976c769', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f995dfc0-b2a1-4084-a702-87e989b90bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d41b47-2a4b-4917-96d9-69384c5781b2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:34 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Volume volume-774b6fab-78f6-4045-9935-d5529976c769 (774b6fab-78f6-4045-9935-d5529976c769): created successfully Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f995dfc0-b2a1-4084-a702-87e989b90bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Flow 'volume_create_manager' (c875b92a-5766-4587-a5c1-10988b4ba971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=163,cinder:SELECT=136,cinder:DELETE=12,cinder:INSERT=40 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:55:34 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c5b11dc1-3342-4036-85b8-a03b31793c25 tempest-ProjectReaderTests-612054726 None] Created volume successfully. Jul 07 10:55:34 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 Jul 07 10:55:34 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:34 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8" returned: 0 in 0.839s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:34 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 Jul 07 10:55:34 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:35 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 1073741824" returned: 0 in 0.996s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:35 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 Jul 07 10:55:35 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Acquiring lock "cinder-774b6fab-78f6-4045-9935-d5529976c769-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Lock "cinder-774b6fab-78f6-4045-9935-d5529976c769-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Acquiring lock "cinder-quobyte-774b6fab-78f6-4045-9935-d5529976c769" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Lock "cinder-quobyte-774b6fab-78f6-4045-9935-d5529976c769" acquired by "delete_volume" :: waited 0.033s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c153b-0eba-470c-a179-c9b976d2fca3]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:35 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 Jul 07 10:55:35 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:35 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:35 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209" returned: 0 in 0.818s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" returned: 0 in 0.692s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:35 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209 Jul 07 10:55:35 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccd182b-1b0f-4268-aa0d-297bde256bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba12cbbf-44ee-4ff7-b405-4f935e63f8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:35 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Volume volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 (b50a33bf-d64d-467b-bd5d-e7904b2bffd0): created successfully Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba12cbbf-44ee-4ff7-b405-4f935e63f8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:35 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (694f48ae-5837-4999-8b64-38dd819d6f4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:35 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c54f0797-9adc-4fe7-b823-7ad4d00e4a8f tempest-ProjectReaderTests-1999001315 None] Created volume successfully. Jul 07 10:55:36 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:36 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769 Jul 07 10:55:36 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:36 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8.0e9ca563-98be-45c2-b855-8c54a33cd209" returned: 0 in 0.688s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-0e9ca563-98be-45c2-b855-8c54a33cd209" released by "_delete_snapshot" :: held 3.299s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40a9cd60-d514-4a68-acac-1d978b435fc8" released by "delete_snapshot" :: held 3.338s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Created reservations ['7ce657c0-beb9-4e0b-8626-7e4781f5f390', '15b4b713-2b66-4714-a90f-df21b5e04080', 'c28938cf-f2a0-4582-ae29-efe38ebaf5df', 'e67c35b7-5747-4d2d-83d4-644af952e0fb'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:36 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6e7cb837-dc40-4af8-991c-d366851d559b tempest-ProjectMemberTests-1828713728 None] Lock "cinder-0e9ca563-98be-45c2-b855-8c54a33cd209-delete_snapshot" released by "delete_snapshot" :: held 3.589s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:36 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-774b6fab-78f6-4045-9935-d5529976c769" returned: 0 in 0.737s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Lock "cinder-quobyte-774b6fab-78f6-4045-9935-d5529976c769" released by "delete_volume" :: held 1.560s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Creating offline snapshot 98c38f62-2d10-4a19-8bca-100347fd13af of volume b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38d2db9-3b23-4b31-927f-a68a255f517c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Created reservations ['b26d30a2-d6f6-4321-8ce3-3a7ec9b6fb54', 'bbaecfe5-d699-409b-97fd-ff591217e188', '75ab296b-c502-4bf4-b08c-f198ec2e0fdd', '2e07b138-a806-4705-9f30-764e784e6307'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:36 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 Jul 07 10:55:36 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:37 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:37 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-40a9cd60-d514-4a68-acac-1d978b435fc8-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-40a9cd60-d514-4a68-acac-1d978b435fc8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-40a9cd60-d514-4a68-acac-1d978b435fc8" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40a9cd60-d514-4a68-acac-1d978b435fc8" acquired by "delete_volume" :: waited 0.024s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec226f75-d23a-413a-b463-108f066d88ba]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:37 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.663s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:37 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Deleted volume successfully. Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-40ceb93f-ffa8-4213-9592-96d27b67e32a tempest-ProjectReaderTests-612054726 None] Lock "cinder-774b6fab-78f6-4045-9935-d5529976c769-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:37 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" returned: 0 in 0.889s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:37 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 Jul 07 10:55:37 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:37 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af 1G Jul 07 10:55:37 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:38 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8" returned: 0 in 0.926s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:38 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8 Jul 07 10:55:38 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:38 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af 1G" returned: 0 in 1.078s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:38 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af Jul 07 10:55:38 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:39 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40a9cd60-d514-4a68-acac-1d978b435fc8" returned: 0 in 0.860s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40a9cd60-d514-4a68-acac-1d978b435fc8" released by "delete_volume" :: held 1.860s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Created reservations ['ad0c0612-572b-4b3c-a95b-c259b5738d43', '9142e36b-94e0-4039-b4fa-fdb61c30e8fe', 'cc232f7e-8560-444c-acb8-03999e127554', '692021d1-91b1-40c5-bb9d-b15c96ceab9f'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:39 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af" returned: 0 in 0.780s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:39 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af is being set with open permissions: ugo+rw Jul 07 10:55:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:39 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:39 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:39 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af Jul 07 10:55:39 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:40 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.776s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (d88493d4-ed08-4e21-98c3-ac8e003500bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dddcc9-2f6b-41cc-99b3-2fa36bb468e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-db404f93-4c8e-4276-9ef7-98905df30801 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-40a9cd60-d514-4a68-acac-1d978b435fc8-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:40 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af" returned: 0 in 0.831s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dddcc9-2f6b-41cc-99b3-2fa36bb468e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026431791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6db26b5-f17d-4266-b614-7e2fb39fa894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:40Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a91cbe-3a8d-41a3-bb4e-85d4372ececa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a91cbe-3a8d-41a3-bb4e-85d4372ececa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e08368-c5f0-4032-8381-af753b65f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e08368-c5f0-4032-8381-af753b65f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6db26b5-f17d-4266-b614-7e2fb39fa894', 'volume_name': 'volume-a6db26b5-f17d-4266-b614-7e2fb39fa894', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180af380-18f7-4be1-88e6-4d0c5feb2abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180af380-18f7-4be1-88e6-4d0c5feb2abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d83521-010a-421c-90b5-cec62ff1c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Volume a6db26b5-f17d-4266-b614-7e2fb39fa894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6db26b5-f17d-4266-b614-7e2fb39fa894', 'volume_size': 1} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:40 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.info Jul 07 10:55:40 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:41 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.info" returned: 0 in 0.665s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:41 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.info is being set with open permissions: ugo+rw Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:41 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.info Jul 07 10:55:41 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:41 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.info" returned: 0 in 0.664s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.039s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026431791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6db26b5-f17d-4266-b614-7e2fb39fa894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:40Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Creating volume a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:41 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:41 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=147,cinder:UPDATE=196,cinder:INSERT=65,cinder:DELETE=18 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:55:41 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 1073741824 Jul 07 10:55:41 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-45f8217a-7860-4b33-8fdb-ecf0ebe2cf2b tempest-ProjectReaderTests-1999001315 None] Create snapshot completed successfully Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-98c38f62-2d10-4a19-8bca-100347fd13af-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-98c38f62-2d10-4a19-8bca-100347fd13af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-98c38f62-2d10-4a19-8bca-100347fd13af" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-98c38f62-2d10-4a19-8bca-100347fd13af" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Deleting offline snapshot 98c38f62-2d10-4a19-8bca-100347fd13af of volume b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] snapshot_file for this snap is: volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd2303-7223-4dd2-bbc8-f5a3bd085f51]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:42 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af Jul 07 10:55:42 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:42 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 1073741824" returned: 0 in 0.876s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:42 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 Jul 07 10:55:42 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:42 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af" returned: 0 in 0.769s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[142051d5-cf05-429b-911c-3502dfd223cb]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:43 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 Jul 07 10:55:43 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:43 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d83521-010a-421c-90b5-cec62ff1c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6db26b5-f17d-4266-b614-7e2fb39fa894', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f609911-feb0-419b-a75f-17cd1ff7bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Volume volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 (a6db26b5-f17d-4266-b614-7e2fb39fa894): created successfully Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f609911-feb0-419b-a75f-17cd1ff7bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (d88493d4-ed08-4e21-98c3-ac8e003500bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0104e84b-3686-4d69-8e96-d13ef23a60d5 tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:55:43 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" returned: 0 in 0.774s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:43 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af Jul 07 10:55:43 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:44 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af" returned: 0 in 0.707s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:44 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af Jul 07 10:55:44 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:44 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot ac49bbda-4897-4903-b818-b00217653894 of volume a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:44 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa962b4-474e-4364-8ba6-8b2d178aa9bd]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:44 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 Jul 07 10:55:44 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:45 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0.98c38f62-2d10-4a19-8bca-100347fd13af" returned: 0 in 0.668s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-98c38f62-2d10-4a19-8bca-100347fd13af" released by "_delete_snapshot" :: held 3.038s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" released by "delete_snapshot" :: held 3.068s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:45 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Created reservations ['5df59b4d-fa9a-43fc-bd1f-5d632c450eb5', 'fb52f53e-8cec-43ad-badd-66f1b7218efd', '3bc5a3b8-b418-4798-b874-51afaa85c4bc', 'ff89c387-88bf-49b6-b4ba-202b43fc93bf'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:45 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Delete snapshot completed successfully. Jul 07 10:55:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-b9d72ca6-afec-4517-9097-c78c518bc854 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-98c38f62-2d10-4a19-8bca-100347fd13af-delete_snapshot" released by "delete_snapshot" :: held 3.201s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:45 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894" returned: 0 in 0.757s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:45 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 1G Jul 07 10:55:45 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:46 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 1G" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-b50a33bf-d64d-467b-bd5d-e7904b2bffd0-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:46 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 Jul 07 10:55:46 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-b50a33bf-d64d-467b-bd5d-e7904b2bffd0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c0aab-9efe-4d4a-8bc2-dad8c48079ac]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:46 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 Jul 07 10:55:46 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:46 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894" returned: 0 in 0.719s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:46 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 is being set with open permissions: ugo+rw Jul 07 10:55:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:46 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 Jul 07 10:55:46 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:47 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" returned: 0 in 0.775s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:47 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0 Jul 07 10:55:47 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:47 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894" returned: 0 in 0.627s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:47 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.info Jul 07 10:55:47 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:47 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" returned: 0 in 0.672s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-b50a33bf-d64d-467b-bd5d-e7904b2bffd0" released by "delete_volume" :: held 1.499s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Created reservations ['375481e1-09c3-4c4c-89f6-8768ba55b450', 'cd362a0b-c64c-4970-acc7-d61f11ea216c', '2809163c-e729-473d-9195-0611f74bff23', 'fb063311-9b4d-4c9a-873a-64e3a8520fb4'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:47 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:47 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:48 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.info" returned: 0 in 0.629s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:48 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.info is being set with open permissions: ugo+rw Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:48 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.info Jul 07 10:55:48 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:48 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.680s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:48 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Deleted volume successfully. Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-82870b22-7a0d-48d9-ae95-8ae68e394603 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-b50a33bf-d64d-467b-bd5d-e7904b2bffd0-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:48 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.info" returned: 0 in 0.694s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.285s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:48 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (048ff7a7-9b65-49ed-8da8-d2ccb539c6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6987aa2b-4819-4a0c-94eb-406a14d696b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:49 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-acdce894-070b-4688-9380-e49076a2f032 tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6987aa2b-4819-4a0c-94eb-406a14d696b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874952940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e9bb2e-328c-406d-9824-1d7f743e9807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:49Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb7875d-7219-42d4-ada6-00b7b7840d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb7875d-7219-42d4-ada6-00b7b7840d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f90ede6-0a64-4ad9-93f2-d08745007ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f90ede6-0a64-4ad9-93f2-d08745007ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e9bb2e-328c-406d-9824-1d7f743e9807', 'volume_name': 'volume-e5e9bb2e-328c-406d-9824-1d7f743e9807', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f4936a-fe44-4914-8901-cd486abfbb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f4936a-fe44-4914-8901-cd486abfbb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bb2dac-58c0-4eba-b426-9093916e27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:49 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Volume e5e9bb2e-328c-406d-9824-1d7f743e9807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e9bb2e-328c-406d-9824-1d7f743e9807', 'volume_size': 1} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874952940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e9bb2e-328c-406d-9824-1d7f743e9807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df1557bd15e4fe2b3e61a440148c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:49Z,use_quota=True,user_id='752abfdd512b49f3891c26323fc6939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Creating volume e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:49 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:49 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 1073741824 Jul 07 10:55:49 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:49 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 1073741824" returned: 0 in 0.840s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-ac49bbda-4897-4903-b818-b00217653894-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-ac49bbda-4897-4903-b818-b00217653894-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-a6db26b5-f17d-4266-b614-7e2fb39fa894" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-a6db26b5-f17d-4266-b614-7e2fb39fa894" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-ac49bbda-4897-4903-b818-b00217653894" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-ac49bbda-4897-4903-b818-b00217653894" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:50 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 Jul 07 10:55:50 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot ac49bbda-4897-4903-b818-b00217653894 of volume a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a8233c-11f0-4fcc-b84b-b074089c8830]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:50 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 Jul 07 10:55:50 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:50 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807" returned: 0 in 0.671s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bb2dac-58c0-4eba-b426-9093916e27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e9bb2e-328c-406d-9824-1d7f743e9807', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5715abf-49d1-4334-a9a3-b28e3513b45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:50 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Volume volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 (e5e9bb2e-328c-406d-9824-1d7f743e9807): created successfully Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5715abf-49d1-4334-a9a3-b28e3513b45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Flow 'volume_create_manager' (048ff7a7-9b65-49ed-8da8-d2ccb539c6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:50 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c643dce4-6e12-4ff9-b1f5-5c808d5ef0c5 tempest-ProjectReaderTests-1999001315 None] Created volume successfully. Jul 07 10:55:50 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894" returned: 0 in 0.820s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6db26b5-f17d-4266-b614-7e2fb39fa894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de3fc1a-e318-4c76-8bfb-99d4758be2b2]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:50 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 Jul 07 10:55:50 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:51 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Creating offline snapshot ed776e1f-3b60-4717-a4b8-95539fb5523c of volume e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:51 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[405df304-b883-45f6-b6a0-f31dc6dae653]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:51 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 Jul 07 10:55:51 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:51 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894" returned: 0 in 0.773s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:51 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 Jul 07 10:55:51 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:52 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807" returned: 0 in 0.789s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:52 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c 1G Jul 07 10:55:52 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:52 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894" returned: 0 in 0.749s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:52 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894 Jul 07 10:55:52 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:52 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c 1G" returned: 0 in 0.788s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:52 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:52 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c Jul 07 10:55:52 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:53 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894.ac49bbda-4897-4903-b818-b00217653894" returned: 0 in 0.673s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-ac49bbda-4897-4903-b818-b00217653894" released by "_delete_snapshot" :: held 3.109s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-a6db26b5-f17d-4266-b614-7e2fb39fa894" released by "delete_snapshot" :: held 3.145s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:53 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Created reservations ['cace168d-add3-42b6-bcda-d4b06f6b9989', 'ed932663-4855-4150-a825-6d0f080e5156', 'eb3a9903-9362-4df4-9d5f-a3cfcc615e3c', '56394803-8b31-4a6d-98d2-a2a66afde2b9'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:53 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:55:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2af594a1-39bd-470d-be00-639f9660e1e8 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-ac49bbda-4897-4903-b818-b00217653894-delete_snapshot" released by "delete_snapshot" :: held 3.296s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:53 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c" returned: 0 in 0.723s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:53 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c is being set with open permissions: ugo+rw Jul 07 10:55:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:53 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c Jul 07 10:55:53 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-a6db26b5-f17d-4266-b614-7e2fb39fa894-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Lock "cinder-a6db26b5-f17d-4266-b614-7e2fb39fa894-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-a6db26b5-f17d-4266-b614-7e2fb39fa894" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:54 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-a6db26b5-f17d-4266-b614-7e2fb39fa894" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c" returned: 0 in 0.687s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[338ac4fe-c0ad-4df5-a7bc-cfe1179e51f0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:54 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.info Jul 07 10:55:54 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:54 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 Jul 07 10:55:54 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:54 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.info" returned: 0 in 0.678s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:54 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.info is being set with open permissions: ugo+rw Jul 07 10:55:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:54 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.info Jul 07 10:55:54 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:55 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894" returned: 0 in 0.751s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:55 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894 Jul 07 10:55:55 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:55 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.info" returned: 0 in 0.674s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b9a6cc1f-1912-439b-bfff-b60dd564c691 tempest-ProjectReaderTests-1999001315 None] Create snapshot completed successfully Jul 07 10:55:55 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-a6db26b5-f17d-4266-b614-7e2fb39fa894" returned: 0 in 0.677s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-a6db26b5-f17d-4266-b614-7e2fb39fa894" released by "delete_volume" :: held 1.486s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Created reservations ['f9e88922-c358-4406-a4de-47e23e495147', '4eb165fa-2607-46be-b9f9-1045680da419', '098d5b9a-cdf8-4e26-8412-08cb3b516d9c', 'ccfe6668-58eb-4682-a379-5f64786f94de'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:55 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:55:55 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-ed776e1f-3b60-4717-a4b8-95539fb5523c-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Lock "cinder-ed776e1f-3b60-4717-a4b8-95539fb5523c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-e5e9bb2e-328c-406d-9824-1d7f743e9807" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-e5e9bb2e-328c-406d-9824-1d7f743e9807" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-ed776e1f-3b60-4717-a4b8-95539fb5523c" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-ed776e1f-3b60-4717-a4b8-95539fb5523c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Deleting offline snapshot ed776e1f-3b60-4717-a4b8-95539fb5523c of volume e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] snapshot_file for this snap is: volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:55:56 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.694s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7891dd-9745-45d3-b320-77922340b77e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:56 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-00df559b-3d3c-4b8a-af53-a17762968aff tempest-ProjectMemberTests-1828713728 None] Lock "cinder-a6db26b5-f17d-4266-b614-7e2fb39fa894-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:56 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c Jul 07 10:55:56 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (860ce9a4-fb81-44f5-bd2e-7b64e6de202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cac03a5-0825-48d9-871b-355daa41c8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cac03a5-0825-48d9-871b-355daa41c8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-618935461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a04d0e7-dad9-4760-a461-8394ab6963f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:57Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ee949-0cc2-41b2-a9b7-c3fd680a1a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ee949-0cc2-41b2-a9b7-c3fd680a1a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaeebe4f-31c9-4d93-93f0-2bd5efd444f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaeebe4f-31c9-4d93-93f0-2bd5efd444f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a04d0e7-dad9-4760-a461-8394ab6963f3', 'volume_name': 'volume-4a04d0e7-dad9-4760-a461-8394ab6963f3', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7171554a-a7a7-43a6-bf70-74ae5eea5889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7171554a-a7a7-43a6-bf70-74ae5eea5889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0961db-a93b-4cdd-b757-465f97f73fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:56 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Volume 4a04d0e7-dad9-4760-a461-8394ab6963f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a04d0e7-dad9-4760-a461-8394ab6963f3', 'volume_size': 1} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-618935461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a04d0e7-dad9-4760-a461-8394ab6963f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:55:57Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Creating volume 4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:56 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:55:57 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:57 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 1073741824 Jul 07 10:55:57 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:57 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c" returned: 0 in 0.792s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5e9bb2e-328c-406d-9824-1d7f743e9807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd0515-db64-4c5c-8ded-acff4dac3675]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:57 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 Jul 07 10:55:57 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:57 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 1073741824" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:57 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:57 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 Jul 07 10:55:57 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:58 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807" returned: 0 in 0.761s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:58 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c Jul 07 10:55:58 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:58 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0961db-a93b-4cdd-b757-465f97f73fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a04d0e7-dad9-4760-a461-8394ab6963f3', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a7bf07-858d-47d9-a70d-bdcced86fcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:55:58 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Volume volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 (4a04d0e7-dad9-4760-a461-8394ab6963f3): created successfully Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a7bf07-858d-47d9-a70d-bdcced86fcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (860ce9a4-fb81-44f5-bd2e-7b64e6de202a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:55:58 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-3899a1fe-8525-4ae6-ae81-bb43e46cc00f tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:55:58 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c" returned: 0 in 0.745s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:58 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:58 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c Jul 07 10:55:58 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot 3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e of volume 4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650c90c-9785-4a82-84bf-3fc7e706d276]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:59 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 Jul 07 10:55:59 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:55:59 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807.ed776e1f-3b60-4717-a4b8-95539fb5523c" returned: 0 in 0.661s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-ed776e1f-3b60-4717-a4b8-95539fb5523c" released by "_delete_snapshot" :: held 3.068s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-e5e9bb2e-328c-406d-9824-1d7f743e9807" released by "delete_snapshot" :: held 3.093s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Created reservations ['273bb100-5251-4144-afe9-535048b684a4', 'f752ff53-804e-4cfc-bee5-bbece73ee355', '21856247-272b-475f-b585-acd789748265', 'b7080813-18f0-4ec3-bc4a-61cb7fc625a8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:55:59 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Delete snapshot completed successfully. Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-fa62ef41-0481-4a91-8072-5cd0f479716b tempest-ProjectReaderTests-1999001315 None] Lock "cinder-ed776e1f-3b60-4717-a4b8-95539fb5523c-delete_snapshot" released by "delete_snapshot" :: held 3.233s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:55:59 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:55:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:55:59 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e 1G Jul 07 10:55:59 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-e5e9bb2e-328c-406d-9824-1d7f743e9807-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-e5e9bb2e-328c-406d-9824-1d7f743e9807-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:00 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "cinder-quobyte-e5e9bb2e-328c-406d-9824-1d7f743e9807" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e 1G" returned: 0 in 0.804s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-e5e9bb2e-328c-406d-9824-1d7f743e9807" acquired by "delete_volume" :: waited 0.032s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:00 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e Jul 07 10:56:00 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c8355-d8b2-42ae-b18c-fde408e4fd9e]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:00 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:00 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 Jul 07 10:56:00 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:01 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" returned: 0 in 0.685s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:01 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e is being set with open permissions: ugo+rw Jul 07 10:56:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:01 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e Jul 07 10:56:01 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:01 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:01 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:01 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807 Jul 07 10:56:01 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:02 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" returned: 0 in 0.679s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:02 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.info Jul 07 10:56:02 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:02 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-e5e9bb2e-328c-406d-9824-1d7f743e9807" returned: 0 in 0.671s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-quobyte-e5e9bb2e-328c-406d-9824-1d7f743e9807" released by "delete_volume" :: held 1.494s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Created reservations ['d6157989-d5ff-4985-9a8a-ddc07a4d82c5', '56561169-3300-474f-8c62-37bdcd350816', 'dbf8ef9e-8daf-40dd-bdc0-b2a6ef38d306', 'bc187a10-157d-4345-b735-c33a386b97e2'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:02 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:02 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:02 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.info" returned: 0 in 0.662s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:02 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.info is being set with open permissions: ugo+rw Jul 07 10:56:02 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:02 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.info Jul 07 10:56:02 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:03 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.658s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:03 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Deleted volume successfully. Jul 07 10:56:03 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ef9e6ade-3117-44ce-be22-408c24151fb8 tempest-ProjectReaderTests-1999001315 None] Lock "cinder-e5e9bb2e-328c-406d-9824-1d7f743e9807-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:03 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.info" returned: 0 in 0.715s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:03 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.411s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:03 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c1aecc48-5cd0-45d5-bc08-9aa61f9a3bbe tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-4a04d0e7-dad9-4760-a461-8394ab6963f3" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-4a04d0e7-dad9-4760-a461-8394ab6963f3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot 3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e of volume 4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc9c463-4453-4879-a06a-a612f3f61eef]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:04 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:04 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e Jul 07 10:56:04 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:05 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" returned: 0 in 0.773s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:05 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a04d0e7-dad9-4760-a461-8394ab6963f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:56:05 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14cd954-cf07-48d9-9d07-3ec67c97dfa0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:05 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:05 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 Jul 07 10:56:05 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:06 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:06 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e Jul 07 10:56:06 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:06 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" returned: 0 in 0.765s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:06 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:06 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e Jul 07 10:56:06 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:07 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:07 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3.3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e" released by "_delete_snapshot" :: held 3.048s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-4a04d0e7-dad9-4760-a461-8394ab6963f3" released by "delete_snapshot" :: held 3.071s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:07 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Created reservations ['f0570457-62f2-46d4-8a6e-2b1d56a03fbe', 'a05e6127-389a-4d9d-8e1a-2a8099806e43', '9c70df3d-f8eb-4266-bd8c-b79632cd277f', 'acca855a-2233-4039-9f2d-5f518edbc00a'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:07 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:56:07 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-8b49374a-54b3-4cb4-b68f-d4b7e4f8dd6f tempest-ProjectMemberTests-1828713728 None] Lock "cinder-3eb5c257-6c1d-41b1-ba5a-32ee260fdc1e-delete_snapshot" released by "delete_snapshot" :: held 3.221s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-4a04d0e7-dad9-4760-a461-8394ab6963f3-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-4a04d0e7-dad9-4760-a461-8394ab6963f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-4a04d0e7-dad9-4760-a461-8394ab6963f3" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:08 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-4a04d0e7-dad9-4760-a461-8394ab6963f3" acquired by "delete_volume" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:08 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d8c2ea-c5d4-4414-90fb-ccc6551ca7ce]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:08 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:08 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 Jul 07 10:56:08 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:09 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3" returned: 0 in 0.776s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:09 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:09 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3 Jul 07 10:56:09 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:10 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-4a04d0e7-dad9-4760-a461-8394ab6963f3" returned: 0 in 0.665s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-4a04d0e7-dad9-4760-a461-8394ab6963f3" released by "delete_volume" :: held 1.509s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Created reservations ['26af0e2f-531a-4158-9340-1def9b55a0d4', 'f77de14a-2fe0-4308-98bb-6e1e1df4dffd', 'c7bc86a5-0359-459b-ae3e-f22a67940154', '018ea078-1513-444b-9be6-ea2701bc2b36'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:10 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:10 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:10 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:11 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.704s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:11 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-6db9f33f-5a33-41fb-968c-8494e267024e tempest-ProjectMemberTests-1828713728 None] Lock "cinder-4a04d0e7-dad9-4760-a461-8394ab6963f3-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (f6eb5e1b-c680-4c64-b0af-0088499d9ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6eddfa-9cee-4cde-9e7d-270db48f22d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6eddfa-9cee-4cde-9e7d-270db48f22d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424498959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b685f2-fc74-4305-95f2-1bf124b1beb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:11Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a64df0b-562b-444f-9638-51bf2c39e2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a64df0b-562b-444f-9638-51bf2c39e2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec144cf9-6353-4890-a1d0-7613eeeeefd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec144cf9-6353-4890-a1d0-7613eeeeefd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b685f2-fc74-4305-95f2-1bf124b1beb6', 'volume_name': 'volume-40b685f2-fc74-4305-95f2-1bf124b1beb6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf687c-d3a1-4c7e-9271-c86d0c929477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf687c-d3a1-4c7e-9271-c86d0c929477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57e2867-5498-4bdb-a4e1-a5c94d774127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:11 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Volume 40b685f2-fc74-4305-95f2-1bf124b1beb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b685f2-fc74-4305-95f2-1bf124b1beb6', 'volume_size': 1} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424498959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b685f2-fc74-4305-95f2-1bf124b1beb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:11Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Creating volume 40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:56:11 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:56:11 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:11 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 1073741824 Jul 07 10:56:11 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:12 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 1073741824" returned: 0 in 0.838s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:12 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:12 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 Jul 07 10:56:12 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:13 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6" returned: 0 in 0.673s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57e2867-5498-4bdb-a4e1-a5c94d774127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b685f2-fc74-4305-95f2-1bf124b1beb6', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4a328f-dcc0-4f91-b564-e2b3a590ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:13 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Volume volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 (40b685f2-fc74-4305-95f2-1bf124b1beb6): created successfully Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4a328f-dcc0-4f91-b564-e2b3a590ce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (f6eb5e1b-c680-4c64-b0af-0088499d9ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:13 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-285e9c93-96e7-4bed-9707-e236b16fc979 tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot 632964af-92f0-4149-a343-892544903755 of volume 40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[973c2cc1-d837-4e91-96be-36a7b90ec1ca]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:13 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:13 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 Jul 07 10:56:13 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:14 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6" returned: 0 in 0.772s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:14 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:14 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 1G Jul 07 10:56:14 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:15 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 1G" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:15 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 Jul 07 10:56:15 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:15 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755" returned: 0 in 0.716s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:15 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 is being set with open permissions: ugo+rw Jul 07 10:56:15 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:15 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 Jul 07 10:56:15 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:16 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755" returned: 0 in 0.695s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:16 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:16 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.info Jul 07 10:56:16 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:17 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.info" returned: 0 in 0.716s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:17 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.info is being set with open permissions: ugo+rw Jul 07 10:56:17 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:17 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.info Jul 07 10:56:17 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:18 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.info" returned: 0 in 0.676s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.526s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:18 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-c25a008d-f1f6-43b6-9b95-475ad6b4da4a tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-632964af-92f0-4149-a343-892544903755-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-632964af-92f0-4149-a343-892544903755-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-40b685f2-fc74-4305-95f2-1bf124b1beb6" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40b685f2-fc74-4305-95f2-1bf124b1beb6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-632964af-92f0-4149-a343-892544903755" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-632964af-92f0-4149-a343-892544903755" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot 632964af-92f0-4149-a343-892544903755 of volume 40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[314bb08b-c171-4063-9ba2-ef3599ee7671]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:18 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:19 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 Jul 07 10:56:19 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (d9839544-035a-42de-ba9e-e4dcb0e7943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:19 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717bf257-19be-4b6a-9ef1-2b803e3f1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755" returned: 0 in 0.802s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40b685f2-fc74-4305-95f2-1bf124b1beb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717bf257-19be-4b6a-9ef1-2b803e3f1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888820233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649bc2e4-550c-4213-ac50-6c5c56bd4c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:20Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e971d43-b666-4dca-85f2-f904c4eb9c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e971d43-b666-4dca-85f2-f904c4eb9c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459465c7-ec5f-4452-9c63-6a9daee52525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459465c7-ec5f-4452-9c63-6a9daee52525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649bc2e4-550c-4213-ac50-6c5c56bd4c39', 'volume_name': 'volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5426564-40e1-4b88-95a5-6bc11bcaaf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5426564-40e1-4b88-95a5-6bc11bcaaf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ba3cfe-cd09-412f-abf6-fc9542357c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:19 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Volume 649bc2e4-550c-4213-ac50-6c5c56bd4c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39', 'volume_size': 1} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888820233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649bc2e4-550c-4213-ac50-6c5c56bd4c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:20Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Creating volume 649bc2e4-550c-4213-ac50-6c5c56bd4c39 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:56:19 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7bf3e4-c6a9-46cf-9879-3027e9d3faca]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:19 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:19 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 1073741824 Jul 07 10:56:19 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:19 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 Jul 07 10:56:19 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:20 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6" returned: 0 in 0.788s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:20 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 1073741824" returned: 0 in 0.813s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:20 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 Jul 07 10:56:20 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:20 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:20 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 Jul 07 10:56:20 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:21 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39" returned: 0 in 0.635s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ba3cfe-cd09-412f-abf6-fc9542357c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf78e6f-2159-4a20-9d4d-a73d4058fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:21 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Volume volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 (649bc2e4-550c-4213-ac50-6c5c56bd4c39): created successfully Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf78e6f-2159-4a20-9d4d-a73d4058fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (d9839544-035a-42de-ba9e-e4dcb0e7943a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:21 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-b1ba4753-a3aa-4201-9570-9ea2b77a6ba9 tempest-ProjectReaderTests-1223585245 None] Created volume successfully. Jul 07 10:56:21 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755" returned: 0 in 0.765s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:21 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755 Jul 07 10:56:21 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-649bc2e4-550c-4213-ac50-6c5c56bd4c39-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-649bc2e4-550c-4213-ac50-6c5c56bd4c39-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-quobyte-649bc2e4-550c-4213-ac50-6c5c56bd4c39" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:21 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-649bc2e4-550c-4213-ac50-6c5c56bd4c39" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dceba7b-4707-42f8-a66f-24fe63cd7d04]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:22 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6.632964af-92f0-4149-a343-892544903755" returned: 0 in 0.655s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-632964af-92f0-4149-a343-892544903755" released by "_delete_snapshot" :: held 3.172s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40b685f2-fc74-4305-95f2-1bf124b1beb6" released by "delete_snapshot" :: held 3.197s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:22 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 Jul 07 10:56:22 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Created reservations ['e7d7efb3-0d97-480c-9fdc-c84ee7d7d0a3', '039a6050-bf90-4259-9d25-8cc2f131af1c', '1fd91c9e-8fd8-488a-ab70-d2947170aacd', '5ec11b32-6cb2-4733-b48b-ab155cc188f8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:22 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-9906c2de-e068-4a70-8995-9258e80b7179 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-632964af-92f0-4149-a343-892544903755-delete_snapshot" released by "delete_snapshot" :: held 3.335s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:22 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39" returned: 0 in 0.752s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:22 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39 Jul 07 10:56:22 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-40b685f2-fc74-4305-95f2-1bf124b1beb6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-40b685f2-fc74-4305-95f2-1bf124b1beb6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-40b685f2-fc74-4305-95f2-1bf124b1beb6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40b685f2-fc74-4305-95f2-1bf124b1beb6" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfed1da-c6db-49d4-9f3b-c9d43ed849e6]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:23 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 Jul 07 10:56:23 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:23 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-649bc2e4-550c-4213-ac50-6c5c56bd4c39" returned: 0 in 0.664s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-649bc2e4-550c-4213-ac50-6c5c56bd4c39" released by "delete_volume" :: held 1.457s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Created reservations ['22e4b3fe-70c6-4a66-b814-f9ef13e07f2c', 'e10ad9b8-6a32-4b06-8309-1ddb77a81e34', '78c14438-8d59-4f25-9cb4-d65179d9299c', '03a37ab1-b324-4d1c-9c53-7bffc431d1ce'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:23 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:23 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:23 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:23 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:24 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6" returned: 0 in 0.823s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:24 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6 Jul 07 10:56:24 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:24 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.785s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:24 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Deleted volume successfully. Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e2c5c73e-38c4-4137-b1bc-565fc73690d5 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-649bc2e4-550c-4213-ac50-6c5c56bd4c39-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:24 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.744s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (c9b11f4c-2527-46e4-bae9-06fe927f39ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926004bb-0a92-47fe-b4dc-a635c796f2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926004bb-0a92-47fe-b4dc-a635c796f2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435961770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3047a240-e0e5-490f-a93d-973606fdbd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:25Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de22d31f-c880-4498-9a60-7bf385521004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de22d31f-c880-4498-9a60-7bf385521004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61818cd-094b-442d-9e7d-fe4aa0a22bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61818cd-094b-442d-9e7d-fe4aa0a22bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3047a240-e0e5-490f-a93d-973606fdbd63', 'volume_name': 'volume-3047a240-e0e5-490f-a93d-973606fdbd63', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5522ee01-5a3a-4bf1-8a53-c0c2daf1393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5522ee01-5a3a-4bf1-8a53-c0c2daf1393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2420744b-bcdc-403f-9aa3-436f4f33b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:24 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Volume 3047a240-e0e5-490f-a93d-973606fdbd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3047a240-e0e5-490f-a93d-973606fdbd63', 'volume_size': 1} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435961770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3047a240-e0e5-490f-a93d-973606fdbd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:25Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Creating volume 3047a240-e0e5-490f-a93d-973606fdbd63 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:56:24 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:24 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-40b685f2-fc74-4305-95f2-1bf124b1beb6" returned: 0 in 0.760s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:24 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 1073741824 Jul 07 10:56:24 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-40b685f2-fc74-4305-95f2-1bf124b1beb6" released by "delete_volume" :: held 1.643s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Created reservations ['7234cdae-bbaf-4820-9fa1-f3d2b25a0492', '52831d35-2f9b-4463-b217-ecce5549f9ab', 'da7a2aff-6e33-4040-a3bc-c30d360170e8', '6acc9760-e697-44a2-b63c-d01f77c0b5c0'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:24 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:24 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:25 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.703s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:25 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-add00e9e-3f21-4430-98c0-b8f8d5fe00d0 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-40b685f2-fc74-4305-95f2-1bf124b1beb6-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:25 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 1073741824" returned: 0 in 0.904s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:25 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 Jul 07 10:56:25 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (5753f5a8-bcdf-4fe9-a037-5a2811bbd22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d867f82-1e0c-4f03-ae31-c45b61e52e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d867f82-1e0c-4f03-ae31-c45b61e52e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314044714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d60306-1a2e-48cf-a90d-85dcb95c9457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:26Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2908cc12-1fe1-45f4-8247-0292ced8818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2908cc12-1fe1-45f4-8247-0292ced8818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7525af7-db72-4525-9e0f-de9bf6412d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7525af7-db72-4525-9e0f-de9bf6412d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d60306-1a2e-48cf-a90d-85dcb95c9457', 'volume_name': 'volume-59d60306-1a2e-48cf-a90d-85dcb95c9457', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17a9aee-130b-4eac-a2dc-c53c16f1668e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17a9aee-130b-4eac-a2dc-c53c16f1668e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2957b7e-db2f-44f4-aefd-1c3e1eb3ef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:25 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Volume 59d60306-1a2e-48cf-a90d-85dcb95c9457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d60306-1a2e-48cf-a90d-85dcb95c9457', 'volume_size': 1} Jul 07 10:56:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:26 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314044714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d60306-1a2e-48cf-a90d-85dcb95c9457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:26Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Creating volume 59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:56:26 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2420744b-bcdc-403f-9aa3-436f4f33b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3047a240-e0e5-490f-a93d-973606fdbd63', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e003309-6706-4d68-a393-446d4bca052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:26 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 1073741824 Jul 07 10:56:26 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:26 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Volume volume-3047a240-e0e5-490f-a93d-973606fdbd63 (3047a240-e0e5-490f-a93d-973606fdbd63): created successfully Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e003309-6706-4d68-a393-446d4bca052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (c9b11f4c-2527-46e4-bae9-06fe927f39ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:26 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-d8c3c953-420b-42a2-9e38-f1881e7ba460 tempest-ProjectReaderTests-1223585245 None] Created volume successfully. Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-3047a240-e0e5-490f-a93d-973606fdbd63-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-3047a240-e0e5-490f-a93d-973606fdbd63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-quobyte-3047a240-e0e5-490f-a93d-973606fdbd63" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-3047a240-e0e5-490f-a93d-973606fdbd63" acquired by "delete_volume" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e03ea9-9d8f-4199-9304-28f18dd24edc]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:27 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 Jul 07 10:56:27 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:27 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 1073741824" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:27 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 Jul 07 10:56:27 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:27 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63" returned: 0 in 0.804s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:27 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63 Jul 07 10:56:27 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:27 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457" returned: 0 in 0.657s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2957b7e-db2f-44f4-aefd-1c3e1eb3ef51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d60306-1a2e-48cf-a90d-85dcb95c9457', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc5e08c-7acb-4a1f-ac12-b3fff37b6be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:27 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Volume volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 (59d60306-1a2e-48cf-a90d-85dcb95c9457): created successfully Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc5e08c-7acb-4a1f-ac12-b3fff37b6be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:27 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (5753f5a8-bcdf-4fe9-a037-5a2811bbd22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:27 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-530a4fbf-f557-40b4-8f80-8c9eb9474f00 tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:56:28 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-3047a240-e0e5-490f-a93d-973606fdbd63" returned: 0 in 0.647s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-3047a240-e0e5-490f-a93d-973606fdbd63" released by "delete_volume" :: held 1.491s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Created reservations ['51bf50b1-8b0a-428b-ac4d-0c6a92db7dee', '568adf95-65f2-4dd3-a833-ab7d2c8ce17d', '9e172b34-4540-4f05-9389-ab323efa8d72', '649a0e45-862d-404c-ac0c-e5e13817dbb8'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:28 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:28 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot e9217e3a-d11a-414a-a5cf-be9ece019c16 of volume 59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:56:29 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.680s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:29 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Deleted volume successfully. Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d10ebad-721c-42e1-8faa-4d0f3065a1c8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a266aba4-8ac3-442f-b6a8-dba3841ecf25 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-3047a240-e0e5-490f-a93d-973606fdbd63-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:29 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 Jul 07 10:56:29 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (b6a30cb2-18a4-46b5-83c8-5db9584cb66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66418a78-9cfc-45c4-91d7-782126b72884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66418a78-9cfc-45c4-91d7-782126b72884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997731618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a305a3-9083-49a1-b506-18ac3e3e3209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:30Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe443d9a-a148-4eed-bb3e-d933cb484c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe443d9a-a148-4eed-bb3e-d933cb484c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b951e8-482e-4393-b387-0bb8cba6e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b951e8-482e-4393-b387-0bb8cba6e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a305a3-9083-49a1-b506-18ac3e3e3209', 'volume_name': 'volume-09a305a3-9083-49a1-b506-18ac3e3e3209', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd3a153-c6e7-4072-92ec-239b33c0ffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd3a153-c6e7-4072-92ec-239b33c0ffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248a71de-35d2-4651-8126-4146b9f9591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:29 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Volume 09a305a3-9083-49a1-b506-18ac3e3e3209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a305a3-9083-49a1-b506-18ac3e3e3209', 'volume_size': 1} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:29 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457" returned: 0 in 0.774s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:29 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 1G Jul 07 10:56:30 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:30 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 1G" returned: 0 in 0.807s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:30 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 Jul 07 10:56:30 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:31 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16" returned: 0 in 0.666s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:31 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 is being set with open permissions: ugo+rw Jul 07 10:56:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:31 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 Jul 07 10:56:31 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:32 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16" returned: 0 in 0.622s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:32 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.info Jul 07 10:56:32 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:32 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.info" returned: 0 in 0.623s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:32 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.info is being set with open permissions: ugo+rw Jul 07 10:56:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:32 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.info Jul 07 10:56:32 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:33 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.info" returned: 0 in 0.639s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.222s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.674s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997731618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a305a3-9083-49a1-b506-18ac3e3e3209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:30Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Creating volume 09a305a3-9083-49a1-b506-18ac3e3e3209 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:56:33 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:56:33 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:33 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 1073741824 Jul 07 10:56:33 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:33 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-9b893456-d47e-4dd3-bac9-4ae334d3aef8 tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:56:34 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 1073741824" returned: 0 in 0.805s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=136,cinder:INSERT=35,cinder:SELECT=109,cinder:DELETE=10 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:34 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 Jul 07 10:56:34 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-e9217e3a-d11a-414a-a5cf-be9ece019c16-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Lock "cinder-e9217e3a-d11a-414a-a5cf-be9ece019c16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-59d60306-1a2e-48cf-a90d-85dcb95c9457" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-59d60306-1a2e-48cf-a90d-85dcb95c9457" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-e9217e3a-d11a-414a-a5cf-be9ece019c16" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-e9217e3a-d11a-414a-a5cf-be9ece019c16" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot e9217e3a-d11a-414a-a5cf-be9ece019c16 of volume 59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad24119-4428-4959-b8cc-74e01b575b0b]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:34 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 Jul 07 10:56:34 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:34 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209" returned: 0 in 0.683s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248a71de-35d2-4651-8126-4146b9f9591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a305a3-9083-49a1-b506-18ac3e3e3209', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f81ab84-140a-410d-adf3-02a34d6c36cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:34 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Volume volume-09a305a3-9083-49a1-b506-18ac3e3e3209 (09a305a3-9083-49a1-b506-18ac3e3e3209): created successfully Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f81ab84-140a-410d-adf3-02a34d6c36cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:34 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (b6a30cb2-18a4-46b5-83c8-5db9584cb66f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:34 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-69274e0d-4322-4634-8d42-f23184751746 tempest-ProjectReaderTests-1223585245 None] Created volume successfully. Jul 07 10:56:35 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16" returned: 0 in 0.770s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:35 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59d60306-1a2e-48cf-a90d-85dcb95c9457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:56:35 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b484a046-5667-463e-9ccf-0513df71f99c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:35 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:35 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 Jul 07 10:56:35 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:35 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-09a305a3-9083-49a1-b506-18ac3e3e3209-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-09a305a3-9083-49a1-b506-18ac3e3e3209-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-quobyte-09a305a3-9083-49a1-b506-18ac3e3e3209" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:36 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457" returned: 0 in 0.791s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-09a305a3-9083-49a1-b506-18ac3e3e3209" acquired by "delete_volume" :: waited 0.028s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:36 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 Jul 07 10:56:36 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac631b87-9db0-494a-a385-b37bd5af51f9]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:36 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 Jul 07 10:56:36 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:36 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16" returned: 0 in 0.764s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:36 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16 Jul 07 10:56:36 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:36 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209" returned: 0 in 0.752s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:36 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209 Jul 07 10:56:36 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:37 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-09a305a3-9083-49a1-b506-18ac3e3e3209" returned: 0 in 0.629s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:37 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457.e9217e3a-d11a-414a-a5cf-be9ece019c16" returned: 0 in 0.681s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-09a305a3-9083-49a1-b506-18ac3e3e3209" released by "delete_volume" :: held 1.451s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-e9217e3a-d11a-414a-a5cf-be9ece019c16" released by "_delete_snapshot" :: held 3.104s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-59d60306-1a2e-48cf-a90d-85dcb95c9457" released by "delete_snapshot" :: held 3.126s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Created reservations ['819bc80a-291e-4b19-b4fd-0489be4db74b', '5cd5ac8b-aff6-4c95-8de4-870720495de8', '1ab490ee-ecdb-48ed-a1d4-9f80ad5dc96f', '3915aaed-9627-49a4-9fc9-4e5a8c538f83'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Created reservations ['19520370-ef4a-4ebe-ac9e-376a6151116e', '48d69145-877b-40b9-9b03-0671e7af532d', '1deacee8-e5ae-405a-8b35-55a1281da31c', '6ee1a32a-199f-4710-b083-cfafd17e4fe3'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:37 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:37 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:37 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:56:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1befcad9-79dd-4feb-aada-3146c33ff8ae tempest-ProjectMemberTests-1828713728 None] Lock "cinder-e9217e3a-d11a-414a-a5cf-be9ece019c16-delete_snapshot" released by "delete_snapshot" :: held 3.318s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:38 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.628s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Deleted volume successfully. Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-eda79bcc-b4f8-4e49-83fd-7ededb213c79 tempest-ProjectReaderTests-1223585245 None] Lock "cinder-09a305a3-9083-49a1-b506-18ac3e3e3209-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-59d60306-1a2e-48cf-a90d-85dcb95c9457-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-59d60306-1a2e-48cf-a90d-85dcb95c9457-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (3bbaa82d-7abe-4968-83b7-b40867466159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac769140-9eab-4840-b3be-ae6d8e15c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac769140-9eab-4840-b3be-ae6d8e15c485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-869729210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6813e9d-9672-4972-a1a6-9aa902a774e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:39Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a56013-8f8f-4911-bfbc-d2380ce45e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a56013-8f8f-4911-bfbc-d2380ce45e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cb5548-080b-4419-8d28-354b026a7a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cb5548-080b-4419-8d28-354b026a7a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6813e9d-9672-4972-a1a6-9aa902a774e4', 'volume_name': 'volume-b6813e9d-9672-4972-a1a6-9aa902a774e4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9d3470-7da4-4acb-a3cb-bc406072e6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9d3470-7da4-4acb-a3cb-bc406072e6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5574471f-0dc1-4c46-9eed-2b55b409e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Volume b6813e9d-9672-4972-a1a6-9aa902a774e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6813e9d-9672-4972-a1a6-9aa902a774e4', 'volume_size': 1} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-869729210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6813e9d-9672-4972-a1a6-9aa902a774e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35c6976bcf43119dd9702e6340ea0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:39Z,use_quota=True,user_id='bd24584dc094446d9bef632ad2484de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Creating volume b6813e9d-9672-4972-a1a6-9aa902a774e4 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:56:38 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-59d60306-1a2e-48cf-a90d-85dcb95c9457" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:38 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 1073741824 Jul 07 10:56:38 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-59d60306-1a2e-48cf-a90d-85dcb95c9457" acquired by "delete_volume" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c33a164-228c-41a1-ba78-74d038945054]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:38 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:38 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 Jul 07 10:56:38 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:39 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 1073741824" returned: 0 in 0.861s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:39 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457" returned: 0 in 0.800s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:39 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457 Jul 07 10:56:39 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:39 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 Jul 07 10:56:39 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:40 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-59d60306-1a2e-48cf-a90d-85dcb95c9457" returned: 0 in 0.645s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-59d60306-1a2e-48cf-a90d-85dcb95c9457" released by "delete_volume" :: held 1.503s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:40 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Created reservations ['dc992749-8951-4302-8a8b-ab393751685c', 'e67a567d-14aa-447a-949e-ee39d76b37e8', 'dbf4eb49-b86d-4e94-a2aa-be54ed38552e', 'b51ef235-7045-4cfa-a9b2-1eab79fd92ed'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4" returned: 0 in 0.674s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5574471f-0dc1-4c46-9eed-2b55b409e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6813e9d-9672-4972-a1a6-9aa902a774e4', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad833f3d-654b-46e3-9483-06fefddc7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:40 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Volume volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 (b6813e9d-9672-4972-a1a6-9aa902a774e4): created successfully Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad833f3d-654b-46e3-9483-06fefddc7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Flow 'volume_create_manager' (3bbaa82d-7abe-4968-83b7-b40867466159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:40 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1ee2ee2a-773e-4bfa-97b2-ca06c3ce1b9f tempest-ProjectReaderTests-1223585245 None] Created volume successfully. Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:40 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:40 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-b6813e9d-9672-4972-a1a6-9aa902a774e4-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Lock "cinder-b6813e9d-9672-4972-a1a6-9aa902a774e4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Acquiring lock "cinder-quobyte-b6813e9d-9672-4972-a1a6-9aa902a774e4" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-b6813e9d-9672-4972-a1a6-9aa902a774e4" acquired by "delete_volume" :: waited 0.017s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc0720-fd80-4e31-bb96-025b1f9e7b85]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:41 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 Jul 07 10:56:41 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:41 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.678s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:41 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-522049e2-0b4f-4dd7-b50f-7a2afc236ec4 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-59d60306-1a2e-48cf-a90d-85dcb95c9457-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (7e41db94-fbe0-42d7-a882-cd2a6e15c64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dae021-e493-459e-95af-6b39e3ea6433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dae021-e493-459e-95af-6b39e3ea6433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714974782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c820cfd6-53ac-4399-9002-3f0e2d658daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:41Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2b0454-bc28-4f62-bc06-a0e2b6e16d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2b0454-bc28-4f62-bc06-a0e2b6e16d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719d2ee9-e270-49a3-be80-36d2977d00c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719d2ee9-e270-49a3-be80-36d2977d00c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c820cfd6-53ac-4399-9002-3f0e2d658daf', 'volume_name': 'volume-c820cfd6-53ac-4399-9002-3f0e2d658daf', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2eed9f-2c88-481b-9f16-30420d9276f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2eed9f-2c88-481b-9f16-30420d9276f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb8cf63-7374-4985-af8a-1c1f15a99197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:41 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Volume c820cfd6-53ac-4399-9002-3f0e2d658daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c820cfd6-53ac-4399-9002-3f0e2d658daf', 'volume_size': 1} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714974782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c820cfd6-53ac-4399-9002-3f0e2d658daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ef91ab7714439a756155e518df024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:56:41Z,use_quota=True,user_id='48cf40156c8341cd8d8f3fe40bebb32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Creating volume c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:56:41 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:41 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf 1073741824 Jul 07 10:56:41 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:41 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4" returned: 0 in 0.814s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:41 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4 Jul 07 10:56:41 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:42 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf 1073741824" returned: 0 in 0.864s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:DELETE=13,cinder:SELECT=101,cinder:UPDATE=146,cinder:INSERT=39 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:42 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-b6813e9d-9672-4972-a1a6-9aa902a774e4" returned: 0 in 0.663s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:42 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf Jul 07 10:56:42 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Lock "cinder-quobyte-b6813e9d-9672-4972-a1a6-9aa902a774e4" released by "delete_volume" :: held 1.523s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Created reservations ['60cc57f6-d9c1-4be2-9507-3a33e2e00ed1', 'ec3b758a-6a5c-464f-b77b-b6c887b82fd1', 'a7bb038a-c73d-43d8-9e7a-37a7930dd938', 'af83e809-3052-452f-8682-fb26085bdfc7'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:42 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:42 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:42 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf" returned: 0 in 0.638s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:56:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb8cf63-7374-4985-af8a-1c1f15a99197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c820cfd6-53ac-4399-9002-3f0e2d658daf', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57004982-69b3-49dc-9dd4-899c3fcdfe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:56:43 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Volume volume-c820cfd6-53ac-4399-9002-3f0e2d658daf (c820cfd6-53ac-4399-9002-3f0e2d658daf): created successfully Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57004982-69b3-49dc-9dd4-899c3fcdfe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Flow 'volume_create_manager' (7e41db94-fbe0-42d7-a882-cd2a6e15c64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:56:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-83aa6a63-1389-4d35-8a33-3b63e186d949 tempest-ProjectMemberTests-1828713728 None] Created volume successfully. Jul 07 10:56:43 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.660s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:43 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Deleted volume successfully. Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-e30041ba-6953-4a28-8d9d-50515fbbc4ad tempest-ProjectReaderTests-1223585245 None] Lock "cinder-b6813e9d-9672-4972-a1a6-9aa902a774e4-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Creating offline snapshot 0f3e7b2d-538b-4476-9b2d-2bb3249b635e of volume c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f98deeb-0869-485b-bfe6-fa30dfb6225d]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:43 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf Jul 07 10:56:43 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:44 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf" returned: 0 in 0.826s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:44 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e 1G Jul 07 10:56:44 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:45 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e 1G" returned: 0 in 0.823s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c820cfd6-53ac-4399-9002-3f0e2d658daf -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:45 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c820cfd6-53ac-4399-9002-3f0e2d658daf -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e Jul 07 10:56:45 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:45 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c820cfd6-53ac-4399-9002-3f0e2d658daf -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e" returned: 0 in 0.674s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:45 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e is being set with open permissions: ugo+rw Jul 07 10:56:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:45 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e Jul 07 10:56:45 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:46 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e" returned: 0 in 0.654s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:46 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.info Jul 07 10:56:46 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:47 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.info" returned: 0 in 0.618s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:47 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.info is being set with open permissions: ugo+rw Jul 07 10:56:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:47 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.info Jul 07 10:56:47 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:47 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.info" returned: 0 in 0.651s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:47 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.321s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:47 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-7fa2579f-1501-4d64-ad5a-a9348dae68ad tempest-ProjectMemberTests-1828713728 None] Create snapshot completed successfully Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-0f3e7b2d-538b-4476-9b2d-2bb3249b635e-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-0f3e7b2d-538b-4476-9b2d-2bb3249b635e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-c820cfd6-53ac-4399-9002-3f0e2d658daf" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-c820cfd6-53ac-4399-9002-3f0e2d658daf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-0f3e7b2d-538b-4476-9b2d-2bb3249b635e" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-0f3e7b2d-538b-4476-9b2d-2bb3249b635e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Deleting offline snapshot 0f3e7b2d-538b-4476-9b2d-2bb3249b635e of volume c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] snapshot_file for this snap is: volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb518e63-3fea-40ff-b400-896acf5a5b2c]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:48 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:49 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e Jul 07 10:56:49 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:49 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e" returned: 0 in 0.766s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:49 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c820cfd6-53ac-4399-9002-3f0e2d658daf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:56:49 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d14ee-6bcc-4272-9d8a-694658174674]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:49 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:49 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf Jul 07 10:56:49 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:50 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf" returned: 0 in 0.763s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:50 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:50 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e Jul 07 10:56:50 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:51 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e" returned: 0 in 0.720s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:51 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e Jul 07 10:56:51 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:51 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:51 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf.0f3e7b2d-538b-4476-9b2d-2bb3249b635e" returned: 0 in 0.643s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-0f3e7b2d-538b-4476-9b2d-2bb3249b635e" released by "_delete_snapshot" :: held 2.983s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:51 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-c820cfd6-53ac-4399-9002-3f0e2d658daf" released by "delete_snapshot" :: held 3.007s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:52 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Created reservations ['cb9ced22-6083-4b90-bee5-e563b8ace339', '79fde841-2819-4cb1-a55b-f0b851df12d4', '93622613-6b5c-4008-854f-019653ec8070', '5305de59-25b7-4fa4-bba0-c202e9a323a5'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:52 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Delete snapshot completed successfully. Jul 07 10:56:52 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-ae400254-859c-451d-9c9d-e19e3f0f08f3 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-0f3e7b2d-538b-4476-9b2d-2bb3249b635e-delete_snapshot" released by "delete_snapshot" :: held 3.132s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-c820cfd6-53ac-4399-9002-3f0e2d658daf-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-c820cfd6-53ac-4399-9002-3f0e2d658daf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "cinder-quobyte-c820cfd6-53ac-4399-9002-3f0e2d658daf" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-c820cfd6-53ac-4399-9002-3f0e2d658daf" acquired by "delete_volume" :: waited 0.014s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1209ca73-4108-4183-b13f-82eca27a8a53]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:53 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf Jul 07 10:56:53 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:53 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf" returned: 0 in 0.743s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:53 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:53 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf Jul 07 10:56:53 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:54 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-c820cfd6-53ac-4399-9002-3f0e2d658daf" returned: 0 in 0.636s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-quobyte-c820cfd6-53ac-4399-9002-3f0e2d658daf" released by "delete_volume" :: held 1.433s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Created reservations ['36f12b69-84e3-4a2a-ac52-3e6997e35dd9', '5f0900ba-82ed-45b6-a21c-5d3c669bbe39', '8ae50f76-7816-4325-a120-e69cf05c9b86', '25a65292-1972-4390-9793-97847ce4d107'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:56:54 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:56:54 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:56:54 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:56:55 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 07 10:56:55 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.624s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:56:55 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:56:55 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Deleted volume successfully. Jul 07 10:56:55 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-1fe3ae45-eb35-4a23-8fc8-c090a51e84a6 tempest-ProjectMemberTests-1828713728 None] Lock "cinder-c820cfd6-53ac-4399-9002-3f0e2d658daf-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:04 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=50,cinder:DELETE=4,cinder:SELECT=34,cinder:INSERT=12 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:57:05 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=16,cinder:INSERT=8,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Flow 'volume_create_manager' (ecf6ca80-fa0d-441a-b604-7c0326d66395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23a9e13-be6a-4855-a268-c1502119d394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23a9e13-be6a-4855-a268-c1502119d394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1549329123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9011b1d1-d9dc-40cf-9ff1-864992036266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31ab987f5c64ec7928371aef83ff854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:57:22Z,use_quota=True,user_id='db657f2432ba449bb64ba9ed9b600067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af19742-f9cb-4e8e-9deb-86ac36785e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af19742-f9cb-4e8e-9deb-86ac36785e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015a36a4-9020-4f6a-9482-a489852a678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015a36a4-9020-4f6a-9482-a489852a678e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9011b1d1-d9dc-40cf-9ff1-864992036266', 'volume_name': 'volume-9011b1d1-d9dc-40cf-9ff1-864992036266', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a14cd07-c12e-4cc1-b47b-e7caae647ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a14cd07-c12e-4cc1-b47b-e7caae647ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073c6e86-ddf6-43ca-b0d1-690b4d94a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:22 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Volume 9011b1d1-d9dc-40cf-9ff1-864992036266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9011b1d1-d9dc-40cf-9ff1-864992036266', 'volume_size': 1} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1549329123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9011b1d1-d9dc-40cf-9ff1-864992036266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31ab987f5c64ec7928371aef83ff854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:57:22Z,use_quota=True,user_id='db657f2432ba449bb64ba9ed9b600067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)}" {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Creating volume 9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:57:22 devstack cinder-volume[87208]: INFO cinder.volume.drivers.remotefs [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] casted to osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 Jul 07 10:57:22 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 1073741824 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:22 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 1073741824 Jul 07 10:57:22 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:23 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 1073741824" returned: 0 in 0.812s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:23 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 Jul 07 10:57:23 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:23 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:57:23 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:23 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266" returned: 0 in 0.650s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'} {{(pid=87208) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073c6e86-ddf6-43ca-b0d1-690b4d94a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9011b1d1-d9dc-40cf-9ff1-864992036266', 'volume_size': 1}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8780781-e954-4969-ab02-e2fe3d073b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:23 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Volume volume-9011b1d1-d9dc-40cf-9ff1-864992036266 (9011b1d1-d9dc-40cf-9ff1-864992036266): created successfully Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8780781-e954-4969-ab02-e2fe3d073b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:23 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Flow 'volume_create_manager' (ecf6ca80-fa0d-441a-b604-7c0326d66395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:57:23 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-e5039928-0240-4341-a4aa-3e5f659e08a6 tempest-SnapshotDependencyTests-1665342498 None] Created volume successfully. Jul 07 10:57:24 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.645s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG oslo_service.periodic_task [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] Running periodic task VolumeManager._thread_info {{(pid=87208) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread count: 28 {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-f259f5b3-f64c-4a55-9820-230173d818d9 None None] thread info: [<_MainThread(MainThread, started 132952843075712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87208) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Creating offline snapshot 1fc6275d-f2f6-4837-936d-234ea4074088 of volume 9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3167c1a-77c8-4706-ab10-c9b176921162]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:24 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:24 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 Jul 07 10:57:24 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:25 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266" returned: 0 in 0.779s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:25 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 1G {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:25 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 1G Jul 07 10:57:25 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:26 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 1G" returned: 0 in 0.769s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9011b1d1-d9dc-40cf-9ff1-864992036266 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:26 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9011b1d1-d9dc-40cf-9ff1-864992036266 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 Jul 07 10:57:26 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:26 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9011b1d1-d9dc-40cf-9ff1-864992036266 -F qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088" returned: 0 in 0.695s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:26 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 is being set with open permissions: ugo+rw Jul 07 10:57:26 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:26 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 Jul 07 10:57:26 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:27 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088" returned: 0 in 0.631s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:27 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:27 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.info Jul 07 10:57:27 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:28 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.info" returned: 0 in 0.667s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:28 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.info is being set with open permissions: ugo+rw Jul 07 10:57:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.info {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:28 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.info Jul 07 10:57:28 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:28 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.info" returned: 0 in 0.638s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:28 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:28 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a1cfdfce-639c-431f-92c5-845f4786221b tempest-SnapshotDependencyTests-1665342498 None] Create snapshot completed successfully Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87208) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Flow 'volume_create_manager' (53c78a69-fc3a-4199-a10b-0eef95303b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557fe410-b6c3-472b-882d-cdf451772c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557fe410-b6c3-472b-882d-cdf451772c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T08:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdba9e81-6561-4f56-9a5e-93c7882a1bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31ab987f5c64ec7928371aef83ff854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T08:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fc6275d-f2f6-4837-936d-234ea4074088,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T08:57:30Z,use_quota=True,user_id='db657f2432ba449bb64ba9ed9b600067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e5f282-f5f2-4b75-bc37-8d629271c297),volume_type_id=51e5f282-f5f2-4b75-bc37-8d629271c297)' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c9b307-5f44-4f82-8246-b65a5d54b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c9b307-5f44-4f82-8246-b65a5d54b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12436af6-f214-4a4e-9faa-1aa9065be855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12436af6-f214-4a4e-9faa-1aa9065be855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fdba9e81-6561-4f56-9a5e-93c7882a1bc6', 'volume_name': 'volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6', 'volume_size': 1, 'snapshot_id': '1fc6275d-f2f6-4837-936d-234ea4074088'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc31ff4-e9b2-42b7-86ae-1142bd16642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc31ff4-e9b2-42b7-86ae-1142bd16642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce69905-26f5-43a1-a52b-7fa9940889a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:30 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Volume fdba9e81-6561-4f56-9a5e-93c7882a1bc6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6', 'volume_size': 1, 'snapshot_id': '1fc6275d-f2f6-4837-936d-234ea4074088'} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-quobyte-1fc6275d-f2f6-4837-936d-234ea4074088-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" by "_create_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-1fc6275d-f2f6-4837-936d-234ea4074088-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Creating volume fdba9e81-6561-4f56-9a5e-93c7882a1bc6 from snapshot 1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Selected osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5 as target Quobyte volume. {{(pid=87208) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-quobyte-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" by "_copy_volume_from_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] snapshot: 1fc6275d-f2f6-4837-936d-234ea4074088, volume: fdba9e81-6561-4f56-9a5e-93c7882a1bc6, {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0a8d7-b8ed-4c14-bdde-a374274229fe]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:30 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:30 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 Jul 07 10:57:30 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:31 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088" returned: 0 in 0.754s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9011b1d1-d9dc-40cf-9ff1-864992036266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:57:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 10:57:31 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Creating direct copy from snapshot {{(pid=87208) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 10:57:31 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b944a72-f1ba-4c2d-a012-af7433b73b52]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:31 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:31 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 Jul 07 10:57:31 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:32 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:32 devstack cinder-volume[87208]: DEBUG cinder.utils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Path /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 not found in is_blk_device check {{(pid=87208) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 10:57:32 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:32 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 Jul 07 10:57:32 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:36 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" returned: 0 in 4.341s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:36 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[88375a2c-2ab2-4917-919d-4b75ba8c2885]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:36 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:36 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 Jul 07 10:57:36 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:37 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266" returned: 0 in 0.907s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:37 devstack cinder-volume[87208]: DEBUG cinder.image.image_utils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Image conversion details: src /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 {{(pid=87208) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 10:57:37 devstack cinder-volume[87208]: INFO cinder.image.image_utils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Converted 1024.00 MB image at 235.80 MB/s Jul 07 10:57:37 devstack cinder-volume[87208]: WARNING cinder.volume.drivers.remotefs [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 is being set with open permissions: ugo+rw Jul 07 10:57:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:37 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 Jul 07 10:57:37 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:37 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" returned: 0 in 0.634s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" released by "_copy_volume_from_snapshot" :: held 7.475s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:37 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-1fc6275d-f2f6-4837-936d-234ea4074088-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" released by "_create_volume_from_snapshot" :: held 7.501s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:37 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.515s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce69905-26f5-43a1-a52b-7fa9940889a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6', 'volume_size': 1, 'snapshot_id': '1fc6275d-f2f6-4837-936d-234ea4074088'}' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb05c94-92a8-4ae2-82e8-492f150459ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 10:57:38 devstack cinder-volume[87208]: INFO cinder.volume.flows.manager.create_volume [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Volume volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 (fdba9e81-6561-4f56-9a5e-93c7882a1bc6): created successfully Jul 07 10:57:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb05c94-92a8-4ae2-82e8-492f150459ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87208) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 10:57:38 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Flow 'volume_create_manager' (53c78a69-fc3a-4199-a10b-0eef95303b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87208) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 10:57:38 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-4aa93504-3e7d-4e92-8e22-ec1152db4852 tempest-SnapshotDependencyTests-1665342498 None] Created volume successfully. Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-1fc6275d-f2f6-4837-936d-234ea4074088-delete_snapshot" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-1fc6275d-f2f6-4837-936d-234ea4074088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-quobyte-9011b1d1-d9dc-40cf-9ff1-864992036266" by "delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-9011b1d1-d9dc-40cf-9ff1-864992036266" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-quobyte-1fc6275d-f2f6-4837-936d-234ea4074088" by "_delete_snapshot" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-1fc6275d-f2f6-4837-936d-234ea4074088" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Deleting offline snapshot 1fc6275d-f2f6-4837-936d-234ea4074088 of volume 9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] snapshot_file for this snap is: volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[957a41c6-8c76-4abd-aef9-2587385744b0]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:39 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 Jul 07 10:57:39 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:39 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088" returned: 0 in 0.740s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.remotefs [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9011b1d1-d9dc-40cf-9ff1-864992036266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87208) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b35816-1503-4649-879c-86fb21c7f1c8]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:39 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:40 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 Jul 07 10:57:40 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:40 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266" returned: 0 in 0.750s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:40 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:40 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 Jul 07 10:57:40 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:41 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088" returned: 0 in 0.708s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:41 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088 Jul 07 10:57:41 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:41 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:41 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266.1fc6275d-f2f6-4837-936d-234ea4074088" returned: 0 in 0.629s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-1fc6275d-f2f6-4837-936d-234ea4074088" released by "_delete_snapshot" :: held 2.919s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-9011b1d1-d9dc-40cf-9ff1-864992036266" released by "delete_snapshot" :: held 2.939s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Created reservations ['528caeef-5e25-4130-afa4-085a3d9cdbec', '9a00a8e0-9a26-4e12-ac13-dec639ea9906', '15050449-d353-4bcc-9939-aecec16b4585', 'f9f79f12-31a7-4cf1-b071-1ab2ae993f16'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:57:42 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Delete snapshot completed successfully. Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-62c574fa-bf75-428c-ab8f-fc000f579c34 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-1fc6275d-f2f6-4837-936d-234ea4074088-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-9011b1d1-d9dc-40cf-9ff1-864992036266-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-9011b1d1-d9dc-40cf-9ff1-864992036266-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-quobyte-9011b1d1-d9dc-40cf-9ff1-864992036266" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-9011b1d1-d9dc-40cf-9ff1-864992036266" acquired by "delete_volume" :: waited 0.013s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1464d92-4f65-4143-8389-3297478f2395]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:42 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:42 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 Jul 07 10:57:42 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:43 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266" returned: 0 in 0.746s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:43 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266 Jul 07 10:57:43 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:43 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-9011b1d1-d9dc-40cf-9ff1-864992036266" returned: 0 in 0.652s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-9011b1d1-d9dc-40cf-9ff1-864992036266" released by "delete_volume" :: held 1.456s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Created reservations ['8fec8c18-7713-440d-84d8-7eaf3de8cc83', '5477f952-19f4-4606-922d-9732b63bd06a', '40b43c59-7225-4ae2-9bf9-5d628282f86e', '39d4f0bc-2359-4715-bd86-30f9bfb64933'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:43 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:43 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:57:43 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-fdba9e81-6561-4f56-9a5e-93c7882a1bc6-delete_volume" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-fdba9e81-6561-4f56-9a5e-93c7882a1bc6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:44 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.652s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:57:44 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Deleted volume successfully. Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "cinder-quobyte-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" by "delete_volume" {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" acquired by "delete_volume" :: waited 0.019s {{(pid=87208) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-a3cbeee5-8c76-4cb5-a232-7971691e2c54 tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-9011b1d1-d9dc-40cf-9ff1-864992036266-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c563a71-d67a-4916-ba4f-7c2d5fd5b1c4]: (4, 'qcow2') {{(pid=88321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 10:57:44 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:44 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 Jul 07 10:57:44 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:45 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" returned: 0 in 0.746s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:45 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6 Jul 07 10:57:45 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:45 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:45 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8/volume-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" returned: 0 in 0.639s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:45 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-quobyte-fdba9e81-6561-4f56-9a5e-93c7882a1bc6" released by "delete_volume" :: held 1.425s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG cinder.quota [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Created reservations ['f3a7ff72-4b70-4fb7-88d8-5cee524f52d7', '184dbdc8-74d1-4f70-83bb-29ec7f76a742', '07956f99-3de4-4780-ba3a-fcd5239914d1', '0d8c0ccd-fc3b-4529-8555-6d07477dff03'] {{(pid=87208) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5': None} {{(pid=87208) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG cinder.volume.drivers.quobyte [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f09f224-00c5-4a54-bff9-92df92b6ede5'] {{(pid=87208) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87208) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 10:57:46 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8 Jul 07 10:57:46 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 10:57:46 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG oslo_concurrency.processutils [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0eef6f82313d4fa1ef4b9d42eae0a3f8" returned: 0 in 0.648s {{(pid=87208) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG cinder.manager [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Notifying Schedulers of capabilities ... {{(pid=87208) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 10:57:46 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Deleted volume successfully. Jul 07 10:57:46 devstack cinder-volume[87208]: DEBUG cinder.coordination [None req-2993fe8b-85c0-4f3e-bfd2-2d3a3504454c tempest-SnapshotDependencyTests-1665342498 None] Lock "cinder-fdba9e81-6561-4f56-9a5e-93c7882a1bc6-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87208) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 10:57:56 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:UPDATE=25,cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:57:56 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 10:58:10 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}